-- Logs begin at Mon 2022-08-01 06:48:08 UTC, end at Mon 2022-08-01 07:55:15 UTC. -- Aug 01 07:28:30.518584 dv-cinder-733062-31-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 07:28:30.528105 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 07:28:30.529929 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 07:28:30 2022] *** Aug 01 07:28:30.529929 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 07:28:30.529929 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 07:28:30.529929 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: nodename: dv-cinder-733062-31-iscsi Aug 01 07:28:30.529929 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: machine: x86_64 Aug 01 07:28:30.529929 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: clock source: unix Aug 01 07:28:30.529929 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: pcre jit disabled Aug 01 07:28:30.529929 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: detected number of CPU cores: 4 Aug 01 07:28:30.529929 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: current working directory: / Aug 01 07:28:30.529929 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: detected binary path: /usr/bin/uwsgi-core Aug 01 07:28:30.530609 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: your processes number limit is 47680 Aug 01 07:28:30.530609 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: your memory page size is 4096 bytes Aug 01 07:28:30.530609 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: detected max file descriptor number: 2048 Aug 01 07:28:30.530609 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: lock engine: pthread robust mutexes Aug 01 07:28:30.530609 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: thunder lock: enabled Aug 01 07:28:30.530609 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 07:28:30.530609 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 07:28:30.569088 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: Python main interpreter initialized at 0x55c9460099c0 Aug 01 07:28:30.569088 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: python threads support enabled Aug 01 07:28:30.569088 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: your server socket listen backlog is limited to 100 connections Aug 01 07:28:30.569088 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: your mercy for graceful operations on workers is 90 seconds Aug 01 07:28:30.569426 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 07:28:30.569510 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: *** Operational MODE: preforking *** Aug 01 07:28:30.569738 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: *** uWSGI is running in multiple interpreter mode *** Aug 01 07:28:30.569738 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: spawned uWSGI master process (pid: 103320) Aug 01 07:28:30.569921 dv-cinder-733062-31-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 07:28:30.570585 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: spawned uWSGI worker 1 (pid: 103321, cores: 1) Aug 01 07:28:30.570782 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: spawned uWSGI worker 2 (pid: 103322, cores: 1) Aug 01 07:28:30.570935 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 07:28:31.228373 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 07:28:31.240308 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 07:28:32.310671 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:28:32.310671 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: from cryptography.utils import int_from_bytes Aug 01 07:28:32.311361 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:28:32.311361 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: from cryptography.utils import int_from_bytes Aug 01 07:28:32.312133 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:28:32.312133 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: from cryptography.utils import int_from_bytes Aug 01 07:28:32.312578 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:28:32.312578 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: from cryptography.utils import int_from_bytes Aug 01 07:28:34.778243 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 07:28:34.778805 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 07:28:34.778998 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 07:28:34.779369 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 07:28:34.779621 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 07:28:34.780000 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.780317 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.780630 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.780940 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.781035 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 07:28:34.781388 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.781470 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 07:28:34.781553 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.781793 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 07:28:34.781903 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.782145 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.782238 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 07:28:34.782396 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 07:28:34.782490 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.782704 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.782799 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.783023 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.783146 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.783354 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-31-iscsi {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.783449 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.783668 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.783774 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.783966 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.784053 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.784269 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.784354 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.784583 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.784671 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.784880 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.784965 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.785193 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.785277 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.785466 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.785560 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.785777 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.785959 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.786105 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-31-iscsi {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.786397 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.786545 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.786697 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.786826 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.787000 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.787145 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.787361 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.787502 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.787650 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.787738 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.787954 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.788092 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.788269 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.788384 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.788581 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.788765 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.788884 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.789088 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.789203 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.789384 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.789546 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-31-iscsi {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.789680 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.789858 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.790011 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.790164 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.790320 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.790472 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.790627 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.791485 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.791604 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.791807 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.791911 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.792171 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.792244 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.792428 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.792617 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.792811 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-31-iscsi {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.793015 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.793238 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.793417 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.793606 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.793785 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.793972 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.794154 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.794154 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.794492 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.794729 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.794881 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.794956 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.795033 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.795136 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.795340 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.795474 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.795599 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.795723 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.795853 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.796018 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.796155 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.796279 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.796403 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.796533 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.796666 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.796800 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.796941 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.797075 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.797201 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.797356 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.797497 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.797639 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.797780 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.797904 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.798029 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.798155 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.798278 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.798410 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.798562 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.798679 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.798820 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.798972 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.799141 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.799281 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.799452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.799592 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.799756 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.799916 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.800080 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.800206 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.800346 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.800475 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.800605 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.800736 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.800869 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.800994 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.801145 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.801273 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.801448 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.801588 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.801753 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.801881 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.802055 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.802183 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.802357 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.802494 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.802659 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.802787 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.802960 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.803127 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.803286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.803428 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.803589 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.803717 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.803904 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.804031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.804213 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.804350 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.804522 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.804649 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.804825 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.804958 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.805127 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.805254 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.805426 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.805556 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.805726 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.805864 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.806040 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.806170 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.806953 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.807267 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.807451 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.807585 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.807728 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.807865 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.807989 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.808123 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.808248 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.808382 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.808520 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.808661 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.808862 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.808999 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.809124 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.809269 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.809407 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.809532 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.809655 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.809785 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.809910 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.810072 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.810202 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.810326 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.810449 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.810607 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.810736 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.810911 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.811042 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.811253 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.811382 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.811560 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.811701 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.811841 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.811966 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.812140 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.812269 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.812455 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.812585 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.812771 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.812902 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.813070 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.813205 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.813369 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.813507 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.813668 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.813798 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.813965 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.814095 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.814276 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.814408 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.814570 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.814699 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.814868 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.814998 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.815188 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.815324 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.815496 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.815623 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.815793 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.815933 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.816103 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.816241 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.816401 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.816537 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.816700 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.816841 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.817005 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.817144 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.817297 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.817425 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.817595 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.817724 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.817904 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.818041 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.818202 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.818332 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.818499 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.818628 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.818796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.819013 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.819163 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.819289 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.819412 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.819536 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.819683 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.819830 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.819978 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.820107 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.820274 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.820403 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.820604 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.820740 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.820864 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.820987 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.821162 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.821292 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.821461 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.821598 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.821758 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.821888 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.822078 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.822207 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.822380 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.822511 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.822683 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.822847 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.822976 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.823202 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.823352 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.823547 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.823677 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.823861 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.823991 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.824180 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.824315 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.824487 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.824622 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.824791 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.824919 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.825095 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.825224 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.825409 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.825545 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:28:34.825734 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.825863 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.826043 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.826173 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.826351 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.826479 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.826660 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.826789 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.826972 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.827136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.827308 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.827437 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.827634 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.827775 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.827945 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.828087 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.828255 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.828392 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.828569 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.828708 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.828876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.829029 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.829221 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.829348 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.829472 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.829610 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.829783 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.829912 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.830094 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.830221 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.830418 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.830556 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.830735 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.830865 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.831046 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.831203 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.831383 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.831526 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.831696 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.831825 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.832002 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.832133 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.832309 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.832439 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.832613 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.832750 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.832929 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.833058 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.833251 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.833391 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.833556 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.833697 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.833868 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.834006 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.834174 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.834305 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.834478 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.834608 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.834787 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.834919 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.835119 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.835251 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.835426 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.835560 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.835746 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.835874 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.836054 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.836184 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.836365 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.836502 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.836671 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.836813 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.836977 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.837105 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.837281 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.837409 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.837609 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.837752 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.837921 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.838049 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.838230 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.838366 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.838565 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.838702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.838879 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.839016 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.839276 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.839427 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.839554 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.839692 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.839818 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.839942 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.840116 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.840245 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.840417 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.840558 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.840725 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.840854 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.841027 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.841203 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.841346 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.841473 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.841621 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.841751 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.841926 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.842056 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.842225 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.842357 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.842532 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.842670 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.842836 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.842966 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.843208 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.843341 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.843467 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.843640 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.843768 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.843892 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.844032 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.844160 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.844346 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.844482 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.844647 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.844791 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.844946 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.845083 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.845256 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.845385 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.845559 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.845697 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.845861 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.845993 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.846164 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.846299 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.846471 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.846609 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.846799 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.846931 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.847130 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.847262 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.847405 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.847541 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.847711 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.847838 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.848026 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.848164 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.848329 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.848458 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.848637 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.848764 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.848947 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.849082 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.849257 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.849472 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.849602 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.849724 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.849846 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.849968 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.850137 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.850266 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.850438 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.850566 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.850739 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.850878 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.851044 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.851190 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.851366 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.851495 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.851668 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.851804 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.851968 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.852106 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.852266 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.852394 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.852565 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.852701 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.852881 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.853010 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.853725 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.853884 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.854008 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.854147 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.854320 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.854447 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.854616 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.854742 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.854920 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.855055 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.855264 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.855389 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.855535 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.855664 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.855838 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.855970 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.856160 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.856301 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.856467 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.856596 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.856768 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.856898 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.857071 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.857200 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.857373 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.857501 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.857693 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.857823 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.858001 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.858129 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.858307 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.858436 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.858621 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.858758 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.858928 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.859093 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.859265 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.859412 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.859619 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.859747 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.859871 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.859995 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.860170 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.860313 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.860481 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.860609 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.860777 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.860905 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.861088 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.861231 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.861423 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.861552 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.861750 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.861879 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.862061 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.862202 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.862373 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.862501 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.862677 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.862803 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.862987 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.863136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.863318 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.863459 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.863623 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.863751 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.863926 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.864065 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.864234 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.864365 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.864548 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.864677 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.864855 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.864991 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.865169 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.865300 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.865478 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.865607 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.865789 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.865918 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.866092 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.866227 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.866399 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.866527 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.866699 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.866830 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.867007 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.867172 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.867349 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.867492 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.867667 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.867796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.867972 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.868101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.868281 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.868419 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.868599 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.868766 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.869550 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.869763 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.869891 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.870033 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.870166 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.870291 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.870414 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.870539 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.870672 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.870806 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.870931 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.871172 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.871306 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.871487 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.871631 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.871799 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.871928 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.872123 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.872250 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.872432 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.872639 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.872777 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.872904 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.873028 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.873151 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.873310 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.873449 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.873615 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.873747 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.873924 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.874051 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.874226 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.874363 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.874537 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.874673 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.874847 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.874977 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.875154 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.875283 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.875455 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.875592 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.875774 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.875909 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.876074 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.876211 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.876372 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.876509 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.876672 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.876803 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.876970 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.877101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.877287 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.877415 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.877602 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.877734 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.877902 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.878033 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.878213 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.878341 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.878761 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.878903 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.879083 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.879215 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.879409 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.879545 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.879712 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.879933 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.880065 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.880188 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.880311 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.880433 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.880616 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.880757 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.880922 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.881052 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.881224 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.881352 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.881528 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.881665 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.881835 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.881971 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.882141 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.882270 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.882451 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.882580 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.882753 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.882881 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.883080 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.883226 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.883392 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.883530 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.883693 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.883822 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.884000 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.884127 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.884310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.884489 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.884682 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.884887 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.885020 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.885216 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.885357 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.885534 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.885663 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.885840 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.885968 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.886151 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.886291 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.886461 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.886599 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.886768 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.886897 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.887128 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.887264 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.887403 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.887536 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.887743 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.887964 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.888095 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.888296 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.888428 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.888612 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.888741 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.888922 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.889049 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.889224 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.889355 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.889526 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.889656 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.889828 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.890044 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.890182 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.890309 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.890432 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.890557 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.890694 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.890829 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.890995 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.891158 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.891321 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.891458 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.891631 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.891761 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.891932 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.892070 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.892237 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.892367 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.892536 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.892666 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.892854 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.892996 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.893159 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.893290 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.893457 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.893586 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.893756 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.893894 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.894054 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.894183 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.894354 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.894482 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.894669 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.894799 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.894974 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.895137 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.895307 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.895438 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.895612 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.895744 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.895934 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.896064 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.896240 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.896448 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.896576 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.896699 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.896823 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.896946 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.897120 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.897258 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.897425 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.897553 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.897733 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.897865 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.898039 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.898178 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.898338 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.898467 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.898645 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.898774 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.898952 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.899132 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.899283 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.899413 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.899590 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.899723 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.899890 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.900549 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.900819 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.900951 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.901075 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.901199 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.901333 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.901466 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.901591 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.901715 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.901870 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.902009 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.902169 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.902311 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.902474 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.902612 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.902778 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.902908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.903098 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.903233 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.903400 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.903527 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.903697 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.903838 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.904001 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.904130 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.904298 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.904425 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.904598 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.904737 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.904899 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.905028 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.905199 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.905326 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.905507 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.905644 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.905808 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.905937 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.906106 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.906235 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.906416 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.906554 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.906714 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.906852 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.907013 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.907188 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.907328 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.907455 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.907630 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.907760 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.907931 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.908060 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.908239 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.908368 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.908549 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.908678 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.908851 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.908982 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.909148 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.909285 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.909452 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.909581 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.909751 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.909880 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.910053 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.910181 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.910350 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.910482 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.910651 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.910802 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.910994 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.911143 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.911283 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.911410 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.911542 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.911677 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.911811 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.911936 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.912111 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.912249 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.912428 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.912569 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.912733 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.912862 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.913033 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.913171 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.913332 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.913474 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.913633 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.913771 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.913933 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.914060 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.914238 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.914369 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.914541 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.914678 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.914844 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.914973 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.915169 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.915308 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.915481 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.915611 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.916365 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.916497 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.916677 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.916806 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.916982 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.917110 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.917289 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.917419 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.917638 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.917768 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.917943 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.918072 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.918271 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.918407 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.918574 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.918709 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.918876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.919013 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.919218 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.919366 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.919527 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.919664 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.919830 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.919958 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.920140 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.920282 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.920445 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.920575 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.920760 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.920891 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.921064 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.921202 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.921370 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.921473 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.921671 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.921775 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.921972 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.922079 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.922278 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.922376 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.922582 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.922696 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.922888 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.922991 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.923220 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.923332 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.923527 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.923626 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.923832 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.923921 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.924138 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.924232 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.924437 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.924523 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.924744 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.924833 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.925055 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.925142 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.925356 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.925441 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.925700 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.925799 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.925967 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.926052 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.926267 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.926367 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.926572 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.926668 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.926872 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.926958 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.927200 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.927311 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.927503 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.927590 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.927811 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.927923 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.928122 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.928217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.928427 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.928557 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.928752 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.928845 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.929063 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.929159 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.929369 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.929469 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.929678 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.929764 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.929982 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.930070 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.930280 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.930373 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.930581 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.930689 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.930997 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.931106 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.931360 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.931491 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.931681 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.931841 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.931999 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.932173 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.932283 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.932480 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.932595 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.932789 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.932912 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.933110 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.933229 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.933412 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.933604 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.933714 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.933950 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.934036 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.934261 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.934355 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.934571 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.934676 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.934880 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.934966 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.935206 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.935298 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.935515 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.935617 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.935826 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.935913 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.936148 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.936289 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.936453 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.936597 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.936757 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.936902 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.937058 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.937220 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.937384 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.937538 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.937689 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.937857 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.938008 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.938159 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.938424 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.938512 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.938733 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.938822 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.939037 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.939151 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.939406 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.939571 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.939717 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.939949 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.940102 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.940243 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.940401 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.940542 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.940689 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.940830 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.940974 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.941113 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.941269 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.941481 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.941639 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.941779 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.941917 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.942053 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.942192 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.942347 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.942487 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.942624 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.942791 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.942939 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.943123 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.943283 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.943425 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.943563 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.943701 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.943839 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.944004 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.944160 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.944323 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.944462 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.944608 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.944748 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.944904 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.945461 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.945625 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.945768 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.945906 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.946054 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.946203 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.946344 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.946483 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.946639 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.946779 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.946949 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.947142 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.947291 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.947431 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.947578 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.947717 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.947862 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.948010 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.948152 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.948291 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.948439 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.948585 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.948732 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.948879 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.949028 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.949175 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.949316 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.949467 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.949615 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.949755 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.949894 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.950039 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.950178 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.950328 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.950476 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.950615 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.950760 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.950899 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.951037 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.951199 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.951358 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.951515 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.951729 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.951873 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.952011 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.952156 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.952315 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.952464 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.952603 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.952740 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.952879 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.953029 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.953175 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.953321 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.953461 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.953605 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.953742 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.953892 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.954031 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.954190 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.954329 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.954469 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.954607 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.954752 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.954899 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.955037 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.955222 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.955363 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.955363 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.955636 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.955774 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.955932 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.956072 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.956217 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.956364 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.956511 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.956650 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.956788 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.956933 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.957080 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.957227 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.957366 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.957504 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.957642 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.957789 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.957936 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.958085 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.958224 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.958362 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.958499 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.958638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.958775 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.958921 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.959092 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.959239 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.959388 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.959529 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.959692 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.959841 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.959980 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.960125 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.960264 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.960410 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.960558 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.960704 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.960844 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.960982 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.961120 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.961258 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.961419 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.961561 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.961716 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.961928 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.962071 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.962210 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.962357 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.962497 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.963271 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.963435 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.963577 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.963744 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.963958 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.964129 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.964271 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.964417 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.965195 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.965343 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.965483 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.965622 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.965760 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.965760 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.966041 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.966180 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.966318 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.966466 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.966605 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.966743 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.966888 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.967029 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.967202 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.967353 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.967499 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.967646 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.967791 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.967791 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.968068 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.968214 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.968370 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.968518 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.968657 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.968794 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.968940 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.969078 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.969224 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.969370 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.969510 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.969648 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.969785 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.969923 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.970083 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.970223 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.970361 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.970499 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.970636 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.970773 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.970919 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.971059 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.971251 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.971390 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.971546 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.971685 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.971843 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.972070 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.972218 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.972358 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.972497 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.972644 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.972783 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.972921 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.973059 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.973196 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.973335 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.973481 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.973637 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.973777 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.973777 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.974038 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.974183 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.974335 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.974475 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.974630 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.974777 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.974916 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.975083 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.975231 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.975379 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.975529 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.975668 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.975806 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.975952 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.976090 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.976228 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.976365 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.976503 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.976649 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.976787 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.976924 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.977071 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.977207 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.977344 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.977495 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.977635 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.977772 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.977909 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.978046 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.978257 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.979008 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.979264 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.979408 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.979547 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.979698 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.979845 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.979987 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.980171 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.980317 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.980487 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.980635 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.980804 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.980951 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.981121 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.981266 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.981404 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.981638 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.981804 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.981945 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.982200 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.982350 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.982489 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.982627 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.982777 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.982926 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.983086 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.983244 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.983435 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.983599 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.983765 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.983912 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.984079 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.984232 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.984401 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.984561 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.984715 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.984871 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.985017 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.985161 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.985312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.985467 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.985614 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.985769 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.985921 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.986073 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.986219 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.986373 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.986518 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.986663 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.986814 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.986959 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.987174 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.987329 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.987486 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.987670 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.987843 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.987999 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.988153 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.988299 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.988444 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.988589 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.988733 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.988885 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.989040 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.989186 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.989337 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.989482 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.989647 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.989793 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.989947 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.990093 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.990238 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.990382 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.990526 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.990679 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.990824 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.990969 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.991142 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.991305 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.991452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.991615 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.991762 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.991907 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.992052 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.992217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.992434 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.992603 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.992750 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.992909 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.993057 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.993202 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.993347 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.993568 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.993739 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.993937 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.994087 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.994240 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.994432 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.994683 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.994831 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.994993 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.995170 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.995319 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.995476 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.995623 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.995768 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.995930 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.996077 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.996222 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.996383 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.996536 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.996683 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.996827 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.996973 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.997125 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.997280 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.997427 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.997572 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.997572 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.997865 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.998021 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.998167 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.998312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.998458 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.998603 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.998754 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.998909 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.999055 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.999248 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.999395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.999541 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.999706 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:34.999862 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.000009 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.000155 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.000299 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.000444 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.000590 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.000743 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.000890 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.001042 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.001188 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.001332 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.001489 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.001489 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.001783 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.001929 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.002080 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.002226 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.002379 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.002614 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.002769 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.002915 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.003060 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.003254 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.003411 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.003825 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.003973 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.004117 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.004261 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.004415 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.004415 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.004693 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.004846 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.005010 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.005158 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.005316 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.005462 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.005607 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.005761 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.005914 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.006060 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.006217 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.006217 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.006493 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.006637 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.006789 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.006789 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.007120 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.007274 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.007420 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.007574 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.007720 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.007880 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.008028 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.008180 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.008329 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.008473 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.008618 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.008771 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.008924 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.008924 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.009208 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.009362 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.009563 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.009874 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.010034 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.010034 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.010321 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.010467 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.010620 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.010772 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.010918 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.011098 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.011254 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.011400 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.011567 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.011714 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.011859 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.012004 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.012156 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.012300 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.012453 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.012618 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.012837 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.012998 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.013146 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.013300 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.013457 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.013603 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.013603 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.013886 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.014030 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.014183 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.014330 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.014474 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.014625 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.014771 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.014923 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.015136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.015292 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.015449 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.015594 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.015749 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.015904 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.016050 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.016195 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.016341 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.016491 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.016637 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.016793 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.016939 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.017091 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.017246 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.017393 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.017544 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.017699 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.017845 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.017997 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.018141 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.018293 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.018448 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.018594 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.018738 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.018882 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.018882 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.019198 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.019360 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.019508 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.019661 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.019814 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.019966 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.020111 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.020263 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.020410 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.020556 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.020700 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.020844 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.020988 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.021151 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.021298 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.021441 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.021586 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.021586 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.021943 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.022099 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.022245 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.022396 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.022541 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.022687 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.022863 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.023118 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.023286 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.023433 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.023578 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.023734 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.023894 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.024040 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.024184 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.024327 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.024471 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.024615 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.024773 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.024920 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.025606 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.025759 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.025913 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.026068 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.026215 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.026359 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.026504 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.026504 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.026790 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.026943 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.027110 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.027264 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.027410 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.027565 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.027713 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.027876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.028023 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.028168 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.028355 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.028508 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.028655 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.028808 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.028956 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.029100 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.029244 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.029398 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.029557 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.029709 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.029863 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.030011 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.030156 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.030300 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.030453 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.030599 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.030752 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.030896 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.031042 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.031226 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.031396 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.031544 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.031688 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.031842 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.031987 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.032142 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.032288 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.032432 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.032576 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.032720 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.032865 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.033017 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.033260 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.033420 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.033566 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.033712 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.033865 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.034019 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.034173 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.034325 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.034470 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.034622 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.034780 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.034939 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.035110 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.035275 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.035422 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.035577 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.035735 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.035890 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.036036 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.036181 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.036326 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.036471 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.036471 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 07:28:35.036757 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.036757 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.036757 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.037178 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.037330 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.037527 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.037857 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.038167 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.038493 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.038818 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.039198 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.039515 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.039859 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.040187 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.040502 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.041377 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.041691 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:28:35.042104 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 07:28:35.189851 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO dbcounter [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Registered counter for database nova_api Aug 01 07:28:35.197296 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO dbcounter [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Registered counter for database nova_api Aug 01 07:28:35.211135 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG oslo_db.sqlalchemy.engines [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:28:35.217525 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_db.sqlalchemy.engines [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:28:35.219643 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG dbcounter [-] [103322] Writer thread running {{(pid=103322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:28:35.223956 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writer thread running {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:28:35.276602 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.context [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc6ae24f-0fe6-4fae-ac28-8855099a2e0b(cell1) {{(pid=103322) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 07:28:35.280608 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG oslo_concurrency.lockutils [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:28:35.280794 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.context [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc6ae24f-0fe6-4fae-ac28-8855099a2e0b(cell1) {{(pid=103321) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 07:28:35.282124 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG oslo_concurrency.lockutils [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:28:35.282924 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG oslo_concurrency.lockutils [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:28:35.284718 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:28:35.284897 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG oslo_concurrency.lockutils [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:28:35.286287 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:28:35.286860 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO dbcounter [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Registered counter for database nova_cell0 Aug 01 07:28:35.287089 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:28:35.289059 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:28:35.291501 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO dbcounter [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Registered counter for database nova_cell0 Aug 01 07:28:35.292205 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO dbcounter [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Registered counter for database nova_cell1 Aug 01 07:28:35.297003 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO dbcounter [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Registered counter for database nova_cell1 Aug 01 07:28:35.299267 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG oslo_db.sqlalchemy.engines [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:28:35.302845 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG oslo_db.sqlalchemy.engines [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:28:35.303606 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_db.sqlalchemy.engines [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:28:35.305308 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG dbcounter [-] [103322] Writer thread running {{(pid=103322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:28:35.307618 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_db.sqlalchemy.engines [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:28:35.309122 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writer thread running {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:28:35.445474 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG dbcounter [-] [103322] Writer thread running {{(pid=103322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:28:35.452646 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writer thread running {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:28:35.454953 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO dbcounter [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Registered counter for database nova_cell0 Aug 01 07:28:35.461335 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO dbcounter [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Registered counter for database nova_cell0 Aug 01 07:28:35.464778 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG oslo_db.sqlalchemy.engines [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:28:35.469506 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG dbcounter [-] [103322] Writer thread running {{(pid=103322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:28:35.471416 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_db.sqlalchemy.engines [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:28:35.476042 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writer thread running {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:28:35.810184 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: WARNING keystonemiddleware.auth_token [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:28:35.817418 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: WARNING keystonemiddleware.auth_token [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:28:35.818368 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: WARNING keystonemiddleware.auth_token [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:28:35.826453 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: WARNING keystonemiddleware.auth_token [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:28:36.157256 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: WARNING keystonemiddleware.auth_token [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:28:36.163121 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: WARNING keystonemiddleware.auth_token [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:28:36.168967 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c9460099c0 pid: 103321 (default app) Aug 01 07:28:36.170980 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:28:36.172173 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Aug 01 07:28:36.172851 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Mon Aug 1 07:28:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:28:36.177196 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: WARNING keystonemiddleware.auth_token [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:28:36.184319 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: WARNING keystonemiddleware.auth_token [None req-d6a607a1-fccd-42e8-bb44-c5f2a77baff8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:28:36.189500 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c9460099c0 pid: 103322 (default app) Aug 01 07:29:52.033128 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:29:52.034139 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 01 07:29:52.034796 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:29:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:29:52.047501 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG dbcounter [-] [103322] Writing DB stats nova_api:SELECT=3 {{(pid=103322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:29:52.048763 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG dbcounter [-] [103322] Writing DB stats nova_cell1:SELECT=3 {{(pid=103322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:29:52.049875 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG dbcounter [-] [103322] Writing DB stats nova_cell0:SELECT=3 {{(pid=103322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:29:52.051229 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG dbcounter [-] [103322] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:29:52.941171 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-8aae52c3-a3e0-4e31-9906-bdd0c6ee2a11 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:29:52.980549 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-8aae52c3-a3e0-4e31-9906-bdd0c6ee2a11 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.938414 Aug 01 07:29:52.981451 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Mon Aug 1 07:29:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:29:55.234225 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:29:55.235297 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-bed4aaf4-c065-4652-bf22-bb80bb4731e1 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001383 Aug 01 07:29:55.236042 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:29:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:29:55.701570 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-1e468551-99c8-4947-929a-a2ec98bc86e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "ram": 256}} {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:29:55.721918 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:29:55.721918 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: warnings.warn(msg) Aug 01 07:29:55.749741 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-1e468551-99c8-4947-929a-a2ec98bc86e3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504685 Aug 01 07:29:55.750329 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Aug 1 07:29:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:29:55.965814 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-eac3e72f-0848-4d69-8c94-40c3f65d5fdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:29:55.970100 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:29:55.970100 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: warnings.warn(msg) Aug 01 07:29:55.972772 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writing DB stats nova_api:SELECT=3 {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:29:55.973722 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writing DB stats nova_cell0:SELECT=3 {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:29:55.974706 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writing DB stats nova_cell1:SELECT=3 {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:29:55.975553 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:29:56.039411 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-eac3e72f-0848-4d69-8c94-40c3f65d5fdb admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279788 Aug 01 07:29:56.040015 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Mon Aug 1 07:29:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:29:58.296173 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-1e468551-99c8-4947-929a-a2ec98bc86e3 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:29:58.297202 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-1e468551-99c8-4947-929a-a2ec98bc86e3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 01 07:29:58.297757 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:29:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:29:59.050370 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-d70a46b2-847d-40f7-9bbd-a895f121a0a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:29:59.073220 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:29:59.073220 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: warnings.warn(msg) Aug 01 07:29:59.095045 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-d70a46b2-847d-40f7-9bbd-a895f121a0a7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.790950 Aug 01 07:29:59.095865 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Aug 1 07:29:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:29:59.108996 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-134c86ea-2e7c-4521-8939-410e48779897 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:29:59.112332 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:29:59.112332 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: warnings.warn(msg) Aug 01 07:29:59.151973 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-134c86ea-2e7c-4521-8939-410e48779897 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046671 Aug 01 07:29:59.152759 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Mon Aug 1 07:29:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:30:01.378343 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-d70a46b2-847d-40f7-9bbd-a895f121a0a7 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:01.380192 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-d70a46b2-847d-40f7-9bbd-a895f121a0a7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002258 Aug 01 07:30:01.383397 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:30:01 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:01.780956 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-c3ccb382-735b-4194-8905-3f3fd67743a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:01.799703 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-c3ccb382-735b-4194-8905-3f3fd67743a3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.412699 Aug 01 07:30:01.800189 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Aug 1 07:30:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:30:01.812622 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-ea9933da-2779-486f-a816-dd429e013100 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:01.837307 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-ea9933da-2779-486f-a816-dd429e013100 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028408 Aug 01 07:30:01.837901 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Mon Aug 1 07:30:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:30:04.087763 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-c3ccb382-735b-4194-8905-3f3fd67743a3 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:04.089713 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-c3ccb382-735b-4194-8905-3f3fd67743a3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002467 Aug 01 07:30:04.090568 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:30:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:04.543715 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-6a1c1bfa-c797-490e-a42e-411704dfb257 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:04.575817 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-6a1c1bfa-c797-490e-a42e-411704dfb257 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474185 Aug 01 07:30:04.576465 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Aug 1 07:30:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:30:04.600397 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-9299d91b-65a3-4c0b-81ef-a98827097ca1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:04.653046 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-9299d91b-65a3-4c0b-81ef-a98827097ca1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056231 Aug 01 07:30:04.654136 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Mon Aug 1 07:30:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:30:06.877955 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-6a1c1bfa-c797-490e-a42e-411704dfb257 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:06.879493 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-6a1c1bfa-c797-490e-a42e-411704dfb257 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 01 07:30:06.880091 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:30:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:07.309725 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-4fd02f8a-b697-4a5c-818a-a54b2afd4b59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:07.328964 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-4fd02f8a-b697-4a5c-818a-a54b2afd4b59 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443363 Aug 01 07:30:07.329667 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Aug 1 07:30:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:30:07.341605 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-dbba5e07-55d7-4b07-9ab5-fe240a4d5ba1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:07.369415 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-dbba5e07-55d7-4b07-9ab5-fe240a4d5ba1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031621 Aug 01 07:30:07.370260 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Mon Aug 1 07:30:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:30:09.827322 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-4fd02f8a-b697-4a5c-818a-a54b2afd4b59 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:09.828349 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-4fd02f8a-b697-4a5c-818a-a54b2afd4b59 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 01 07:30:09.828759 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:30:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:10.451943 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-3df6bff4-1040-4e19-a9fe-690f9536c50b admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:10.495734 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-3df6bff4-1040-4e19-a9fe-690f9536c50b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.658952 Aug 01 07:30:10.496720 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Mon Aug 1 07:30:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:30:12.932349 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-4fd02f8a-b697-4a5c-818a-a54b2afd4b59 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:12.933359 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-4fd02f8a-b697-4a5c-818a-a54b2afd4b59 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 01 07:30:12.933766 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:30:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:13.363526 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-ffbe3206-3a3c-4072-aebe-c5dccc329cf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "id": "1"}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:13.384070 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-ffbe3206-3a3c-4072-aebe-c5dccc329cf2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.444594 Aug 01 07:30:13.384624 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Aug 1 07:30:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:30:13.397056 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-48a3d712-bde0-489a-b7b2-482d5eeeb9e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:13.421650 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-48a3d712-bde0-489a-b7b2-482d5eeeb9e0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028504 Aug 01 07:30:13.422250 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Mon Aug 1 07:30:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:30:15.766193 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-ffbe3206-3a3c-4072-aebe-c5dccc329cf2 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:15.767311 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-ffbe3206-3a3c-4072-aebe-c5dccc329cf2 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 01 07:30:15.767708 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:30:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:16.198860 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-978356b7-b4c8-46a7-bcad-9ddea37dc368 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "disk": 20}} {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:16.218630 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-978356b7-b4c8-46a7-bcad-9ddea37dc368 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445024 Aug 01 07:30:16.226623 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Aug 1 07:30:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:30:16.232080 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-1044225b-6f67-4308-89e6-2124bfd0f304 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:16.258823 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-1044225b-6f67-4308-89e6-2124bfd0f304 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031085 Aug 01 07:30:16.259432 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Mon Aug 1 07:30:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:30:18.499766 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-978356b7-b4c8-46a7-bcad-9ddea37dc368 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:18.501023 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-978356b7-b4c8-46a7-bcad-9ddea37dc368 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 01 07:30:18.501441 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:18.923150 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-d751fda3-31fe-4497-ad63-e0a05b6c69c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "ram": 4096, "disk": 40, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:18.943885 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-d751fda3-31fe-4497-ad63-e0a05b6c69c4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.435147 Aug 01 07:30:18.952200 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Aug 1 07:30:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:30:18.970972 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-ffdc07de-5648-449e-a11d-30add4e6e43a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:19.089673 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-ffdc07de-5648-449e-a11d-30add4e6e43a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131078 Aug 01 07:30:19.090562 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Mon Aug 1 07:30:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:30:21.328396 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-d751fda3-31fe-4497-ad63-e0a05b6c69c4 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:21.329411 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-d751fda3-31fe-4497-ad63-e0a05b6c69c4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 01 07:30:21.329815 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:30:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:21.797979 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-1b6d164d-030c-428b-a9e6-2f20ce829773 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "name": "m1.large", "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:21.823149 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-1b6d164d-030c-428b-a9e6-2f20ce829773 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.487322 Aug 01 07:30:21.823839 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Aug 1 07:30:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:30:21.836360 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-78703afd-4ab2-40a5-9dd2-33548e88954b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:21.863033 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-78703afd-4ab2-40a5-9dd2-33548e88954b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030332 Aug 01 07:30:21.863966 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Mon Aug 1 07:30:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:30:24.135037 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-1b6d164d-030c-428b-a9e6-2f20ce829773 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:24.136079 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-1b6d164d-030c-428b-a9e6-2f20ce829773 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 01 07:30:24.138437 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:24.603188 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-9b8e196f-131d-4f58-bcce-396337bf2b12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:24.623841 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-9b8e196f-131d-4f58-bcce-396337bf2b12 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.481581 Aug 01 07:30:24.626491 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Aug 1 07:30:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:30:24.636753 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-199e54bf-445f-4130-8ac5-77f2fca7f6dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:24.642556 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG dbcounter [-] [103322] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:30:24.664157 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-199e54bf-445f-4130-8ac5-77f2fca7f6dd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030952 Aug 01 07:30:24.679986 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Mon Aug 1 07:30:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:30:43.951431 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-9b8e196f-131d-4f58-bcce-396337bf2b12 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:43.952453 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-9b8e196f-131d-4f58-bcce-396337bf2b12 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 01 07:30:43.952854 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:30:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:44.343947 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-2c85a02f-876f-4927-8767-88ff2cd9fdb0 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:44.362540 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-2c85a02f-876f-4927-8767-88ff2cd9fdb0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403334 Aug 01 07:30:44.363071 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Mon Aug 1 07:30:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:30:45.421458 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-9b8e196f-131d-4f58-bcce-396337bf2b12 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:45.422467 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-9b8e196f-131d-4f58-bcce-396337bf2b12 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 01 07:30:45.422860 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:45.944733 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-85fc9fce-b373-4569-93b3-3cc463a18084 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:45.950368 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.wsgi [None req-85fc9fce-b373-4569-93b3-3cc463a18084 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-85fc9fce-b373-4569-93b3-3cc463a18084 admin admin] Request method failure captured: Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Accept: application/json Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Accept-Encoding: gzip, deflate Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Connection: keep-alive Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Content-Length: 0 Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Host: 10.222.0.40 Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Openstack-Api-Version: compute 2.90 Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Openstack-System-Scope: None Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: User-Agent: python-novaclient Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Auth-Token: gAAAAABi54ElMjsfliZfquyQ6rjddTvtNDmG9tT5WyqOjSONxZBs1hp2pkptAyyE2D7qXxy6A4EWumyXF-VvYLvwBaXPwV1KoeRd5eh3PlkNoYrxOlH5Fwf6qLq0VDijcdLqgFHVZTzuQdLb6EdpIz3oL0UcjiQfiRg9a6hZger-K6MrULvYvhs Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Domain-Id: None Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Domain-Name: None Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Identity-Status: Confirmed Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Is-Admin-Project: True Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Domain-Id: default Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Domain-Name: Default Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Name: admin Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Role: admin,member,reader Aug 01 07:30:45.953665 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Roles: admin,member,reader Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a9fa482966924d01a3dc7809fa925311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Tenant: admin Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Tenant-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Tenant-Name: admin Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User: admin Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Domain-Id: default Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Domain-Name: Default Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Id: aae3d76a87c24d97b28248f570423938 Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Name: admin Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: method: > Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: exception: Flavor 42 could not be found. Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: action_args: {'id': '42'} Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:30:45.955395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:45.956638 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:45.958031 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-85fc9fce-b373-4569-93b3-3cc463a18084 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:30:45.959420 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-85fc9fce-b373-4569-93b3-3cc463a18084 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393602 Aug 01 07:30:45.959420 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Aug 1 07:30:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 07:30:45.965143 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-8b751544-2c85-4cd6-83d4-ece17632f7cf admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:45.969132 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:30:45.989817 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-8b751544-2c85-4cd6-83d4-ece17632f7cf admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028625 Aug 01 07:30:45.990370 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 1 07:30:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:30:46.000071 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-8debe437-c4c0-4cd2-908a-6e9dca35117c admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:46.025349 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-8debe437-c4c0-4cd2-908a-6e9dca35117c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028834 Aug 01 07:30:46.025882 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 1 07:30:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:30:46.036064 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-89439721-4ec3-49a4-b4f6-4cb8874101f4 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:46.042424 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.wsgi [None req-89439721-4ec3-49a4-b4f6-4cb8874101f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-89439721-4ec3-49a4-b4f6-4cb8874101f4 admin admin] Request method failure captured: Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Accept: application/json Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Accept-Encoding: gzip, deflate Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Connection: keep-alive Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Content-Length: 0 Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Host: 10.222.0.40 Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Openstack-Api-Version: compute 2.90 Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Openstack-System-Scope: None Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: User-Agent: python-novaclient Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Auth-Token: gAAAAABi54ElMjsfliZfquyQ6rjddTvtNDmG9tT5WyqOjSONxZBs1hp2pkptAyyE2D7qXxy6A4EWumyXF-VvYLvwBaXPwV1KoeRd5eh3PlkNoYrxOlH5Fwf6qLq0VDijcdLqgFHVZTzuQdLb6EdpIz3oL0UcjiQfiRg9a6hZger-K6MrULvYvhs Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Domain-Id: None Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Domain-Name: None Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Identity-Status: Confirmed Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Is-Admin-Project: True Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Domain-Id: default Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Domain-Name: Default Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Name: admin Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Role: admin,member,reader Aug 01 07:30:46.045776 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Roles: admin,member,reader Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a9fa482966924d01a3dc7809fa925311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Tenant: admin Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Tenant-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Tenant-Name: admin Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User: admin Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Domain-Id: default Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Domain-Name: Default Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Id: aae3d76a87c24d97b28248f570423938 Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Name: admin Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: method: > Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: exception: Flavor 42 could not be found. Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: action_args: {'id': '42'} Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:30:46.047312 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:46.048101 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:46.049136 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-89439721-4ec3-49a4-b4f6-4cb8874101f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:30:46.050113 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-89439721-4ec3-49a4-b4f6-4cb8874101f4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015494 Aug 01 07:30:46.050113 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Aug 1 07:30:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 07:30:47.009136 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-8debe437-c4c0-4cd2-908a-6e9dca35117c admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:47.010147 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-8debe437-c4c0-4cd2-908a-6e9dca35117c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 01 07:30:47.010537 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:47.650436 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-a787bfac-c64c-45cc-a151-9a44cf6947f1 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:47.655768 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.wsgi [None req-a787bfac-c64c-45cc-a151-9a44cf6947f1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-a787bfac-c64c-45cc-a151-9a44cf6947f1 admin admin] Request method failure captured: Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Accept: application/json Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Accept-Encoding: gzip, deflate Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Connection: keep-alive Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Content-Length: 0 Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Host: 10.222.0.40 Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Openstack-Api-Version: compute 2.90 Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Openstack-System-Scope: None Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: User-Agent: python-novaclient Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Auth-Token: gAAAAABi54EmFox6YAeS5BdAz6axpyUqJFCpD2wU68tgwggOzt2hDXkTSAndGKCiAGm8JJS4hZpIU5JCsMxU_kArejia1338Nmh3rSFZ2uoxZ3Eg3zEPCte8AZOUUyzGDMQA4U75snbjDXE-bk1gNco3TBclVkp47O9Gq2iThaKBFKzjNpSULwM Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Domain-Id: None Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Domain-Name: None Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Identity-Status: Confirmed Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Is-Admin-Project: True Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Domain-Id: default Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Domain-Name: Default Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Name: admin Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Role: admin,member,reader Aug 01 07:30:47.657286 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Roles: admin,member,reader Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a9fa482966924d01a3dc7809fa925311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Tenant: admin Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Tenant-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Tenant-Name: admin Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User: admin Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Domain-Id: default Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Domain-Name: Default Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Id: aae3d76a87c24d97b28248f570423938 Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Name: admin Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: method: > Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: exception: Flavor 84 could not be found. Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: action_args: {'id': '84'} Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:30:47.659496 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:47.660284 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:47.661645 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-a787bfac-c64c-45cc-a151-9a44cf6947f1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:30:47.662899 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-a787bfac-c64c-45cc-a151-9a44cf6947f1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.510999 Aug 01 07:30:47.662899 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Aug 1 07:30:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 07:30:47.669082 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-06858b96-957f-4415-868b-36f01dbb22ea admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:47.684315 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-06858b96-957f-4415-868b-36f01dbb22ea admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018503 Aug 01 07:30:47.684890 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 1 07:30:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:30:47.694586 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-95e980bb-762d-44c4-a557-2196a2dfc043 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:47.711681 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-95e980bb-762d-44c4-a557-2196a2dfc043 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020573 Aug 01 07:30:47.712221 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 1 07:30:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:30:47.722295 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-c3a7b06f-de99-4425-bf93-880aad105cdf admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:47.727730 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.wsgi [None req-c3a7b06f-de99-4425-bf93-880aad105cdf admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-c3a7b06f-de99-4425-bf93-880aad105cdf admin admin] Request method failure captured: Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Accept: application/json Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Accept-Encoding: gzip, deflate Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Connection: keep-alive Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Content-Length: 0 Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Host: 10.222.0.40 Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Openstack-Api-Version: compute 2.90 Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Openstack-System-Scope: None Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: User-Agent: python-novaclient Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Auth-Token: gAAAAABi54EmFox6YAeS5BdAz6axpyUqJFCpD2wU68tgwggOzt2hDXkTSAndGKCiAGm8JJS4hZpIU5JCsMxU_kArejia1338Nmh3rSFZ2uoxZ3Eg3zEPCte8AZOUUyzGDMQA4U75snbjDXE-bk1gNco3TBclVkp47O9Gq2iThaKBFKzjNpSULwM Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Domain-Id: None Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Domain-Name: None Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Identity-Status: Confirmed Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Is-Admin-Project: True Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Domain-Id: default Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Domain-Name: Default Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Name: admin Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Role: admin,member,reader Aug 01 07:30:47.729217 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Roles: admin,member,reader Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a9fa482966924d01a3dc7809fa925311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Tenant: admin Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Tenant-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Tenant-Name: admin Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User: admin Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Domain-Id: default Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Domain-Name: Default Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Id: aae3d76a87c24d97b28248f570423938 Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Name: admin Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: method: > Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: exception: Flavor 84 could not be found. Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: action_args: {'id': '84'} Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:30:47.730702 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:47.731796 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:47.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-c3a7b06f-de99-4425-bf93-880aad105cdf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:30:47.734395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-c3a7b06f-de99-4425-bf93-880aad105cdf admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012546 Aug 01 07:30:47.734395 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Aug 1 07:30:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 07:30:48.686680 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-95e980bb-762d-44c4-a557-2196a2dfc043 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:48.687766 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-95e980bb-762d-44c4-a557-2196a2dfc043 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 01 07:30:48.688160 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:30:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:49.333746 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-147d8d6c-0831-40f7-9974-120123d1a4aa admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:49.339410 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.wsgi [None req-147d8d6c-0831-40f7-9974-120123d1a4aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-147d8d6c-0831-40f7-9974-120123d1a4aa admin admin] Request method failure captured: Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Accept: application/json Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Accept-Encoding: gzip, deflate Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Connection: keep-alive Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Content-Length: 0 Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Host: 10.222.0.40 Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Openstack-Api-Version: compute 2.90 Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Openstack-System-Scope: None Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: User-Agent: python-novaclient Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Auth-Token: gAAAAABi54EofDWmN-qpEBIjPXM2T2WVEs-FCrF6e90gC7n2HDpSkCNk3jg3ctg_ZBBJHDGzkZylY03D5ajmdoQj1-NNhgy0CDq00qegyrLStkxGUQjow710rFfP0FZIK4e20LMVsA5Qlpsf3WDxFxG6YpzMIqHBOtLDFYr9ha2lY1N-IJkffq4 Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Domain-Id: None Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Domain-Name: None Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Identity-Status: Confirmed Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Is-Admin-Project: True Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Domain-Id: default Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Domain-Name: Default Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Project-Name: admin Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Role: admin,member,reader Aug 01 07:30:49.340876 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Roles: admin,member,reader Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a9fa482966924d01a3dc7809fa925311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Tenant: admin Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Tenant-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-Tenant-Name: admin Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User: admin Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Domain-Id: default Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Domain-Name: Default Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Id: aae3d76a87c24d97b28248f570423938 Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: X-User-Name: admin Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: method: > Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: exception: Flavor 451 could not be found. Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: action_args: {'id': '451'} Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:30:49.342430 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:49.343302 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: ERROR nova.api.openstack.wsgi Aug 01 07:30:49.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-147d8d6c-0831-40f7-9974-120123d1a4aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:30:49.346263 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-147d8d6c-0831-40f7-9974-120123d1a4aa admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.513536 Aug 01 07:30:49.346263 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 1 07:30:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 07:30:49.352569 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-43de5a34-e5de-46cd-9131-f0ca3e2fce80 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:49.367197 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-43de5a34-e5de-46cd-9131-f0ca3e2fce80 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018117 Aug 01 07:30:49.367714 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 1 07:30:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:30:49.377117 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:49.391673 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018339 Aug 01 07:30:49.392695 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 1 07:30:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:30:49.401970 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-61c3ecf7-a631-4837-840c-42f952585507 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:49.407257 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.wsgi [None req-61c3ecf7-a631-4837-840c-42f952585507 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-61c3ecf7-a631-4837-840c-42f952585507 admin admin] Request method failure captured: Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Accept: application/json Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Accept-Encoding: gzip, deflate Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Connection: keep-alive Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Content-Length: 0 Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Host: 10.222.0.40 Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Openstack-Api-Version: compute 2.90 Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Openstack-System-Scope: None Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: User-Agent: python-novaclient Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Auth-Token: gAAAAABi54EofDWmN-qpEBIjPXM2T2WVEs-FCrF6e90gC7n2HDpSkCNk3jg3ctg_ZBBJHDGzkZylY03D5ajmdoQj1-NNhgy0CDq00qegyrLStkxGUQjow710rFfP0FZIK4e20LMVsA5Qlpsf3WDxFxG6YpzMIqHBOtLDFYr9ha2lY1N-IJkffq4 Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Domain-Id: None Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Domain-Name: None Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Identity-Status: Confirmed Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Is-Admin-Project: True Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Domain-Id: default Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Domain-Name: Default Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Project-Name: admin Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Role: admin,member,reader Aug 01 07:30:49.409310 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Roles: admin,member,reader Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a9fa482966924d01a3dc7809fa925311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a9fa482966924d01a3dc7809fa925311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Tenant: admin Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Tenant-Id: a9fa482966924d01a3dc7809fa925311 Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-Tenant-Name: admin Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User: admin Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Domain-Id: default Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Domain-Name: Default Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Id: aae3d76a87c24d97b28248f570423938 Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: X-User-Name: admin Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: method: > Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: exception: Flavor 451 could not be found. Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: action_args: {'id': '451'} Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:30:49.410908 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:49.412117 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: ERROR nova.api.openstack.wsgi Aug 01 07:30:49.413452 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-61c3ecf7-a631-4837-840c-42f952585507 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:30:49.414759 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-61c3ecf7-a631-4837-840c-42f952585507 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012144 Aug 01 07:30:49.414759 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 1 07:30:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 07:30:50.380055 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:50.381065 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 01 07:30:50.381449 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:30:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:50.905292 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-5d87242c-1394-4ba9-b0c7-d547ca8374c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:50.926022 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-5d87242c-1394-4ba9-b0c7-d547ca8374c5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406823 Aug 01 07:30:50.926573 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Aug 1 07:30:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:30:51.894165 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:51.895207 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 01 07:30:51.895609 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:52.416855 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-2a085553-2df6-4ad6-98f7-26095ce9d60a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:52.435350 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-2a085553-2df6-4ad6-98f7-26095ce9d60a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.398783 Aug 01 07:30:52.435895 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Aug 1 07:30:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:30:53.390277 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:53.391318 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 01 07:30:53.391720 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:30:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:53.914632 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-10a7f267-87db-4345-9c29-c6a811b08dd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:53.933973 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-10a7f267-87db-4345-9c29-c6a811b08dd5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.405819 Aug 01 07:30:53.934514 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Aug 1 07:30:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:30:54.910755 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:54.911812 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 01 07:30:54.912214 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:30:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:55.434989 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-cb712ead-c25c-4ebd-99a2-b0e1c88edc35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:30:55.453181 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-cb712ead-c25c-4ebd-99a2-b0e1c88edc35 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400672 Aug 01 07:30:55.453723 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Aug 1 07:30:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:30:56.429466 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:56.430473 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 01 07:30:56.430870 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:30:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:30:56.957704 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-969ee57a-99d6-4305-9462-b06eb6c90006 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:30:56.978620 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-969ee57a-99d6-4305-9462-b06eb6c90006 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407142 Aug 01 07:30:56.979169 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Mon Aug 1 07:30:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:31:48.216071 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:31:48.217110 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-e8cf96e0-cc71-4c10-9d81-7452613331c7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 01 07:31:48.217504 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Mon Aug 1 07:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:31:48.228463 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:31:48.602853 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-3b8928d1-53d6-4cd4-b2f8-f107c63fbf01 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:31:48.622819 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-3b8928d1-53d6-4cd4-b2f8-f107c63fbf01 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398771 Aug 01 07:31:48.623378 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Mon Aug 1 07:31:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:31:48.647421 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-bc910eb6-02c9-4753-be30-118069e0ea41 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:31:48.650761 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG dbcounter [-] [103322] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:31:48.656156 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-bc910eb6-02c9-4753-be30-118069e0ea41 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012372 Aug 01 07:31:48.656671 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Mon Aug 1 07:31:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:31:48.668719 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-50ced034-9512-464a-92b2-c80fdb7cb5a5 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:31:48.676799 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-50ced034-9512-464a-92b2-c80fdb7cb5a5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011666 Aug 01 07:31:48.677329 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Mon Aug 1 07:31:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:31:48.688566 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-adc68a0c-541b-453b-a1bd-685fa91c6f56 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:31:48.697444 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-adc68a0c-541b-453b-a1bd-685fa91c6f56 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012333 Aug 01 07:31:48.697950 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Mon Aug 1 07:31:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:31:48.709483 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-faa87e24-1161-4743-814c-de00418ec388 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:31:48.716905 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-faa87e24-1161-4743-814c-de00418ec388 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010921 Aug 01 07:31:48.717403 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Mon Aug 1 07:31:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:35:06.972522 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-adc68a0c-541b-453b-a1bd-685fa91c6f56 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:35:06.973525 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-adc68a0c-541b-453b-a1bd-685fa91c6f56 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 01 07:35:06.973912 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:35:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:35:07.116573 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writing DB stats nova_api:SELECT=6 {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:35:07.278241 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-38eef371-6517-4950-89f1-1ae1a7703fa2 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:35:07.280596 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:35:07.280596 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: warnings.warn(msg) Aug 01 07:35:07.281783 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-38eef371-6517-4950-89f1-1ae1a7703fa2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:35:07.282214 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-38eef371-6517-4950-89f1-1ae1a7703fa2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:35:07.282980 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-38eef371-6517-4950-89f1-1ae1a7703fa2 admin admin] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:35:07.283423 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-38eef371-6517-4950-89f1-1ae1a7703fa2 admin admin] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:35:07.316572 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-38eef371-6517-4950-89f1-1ae1a7703fa2 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.201494 Aug 01 07:35:07.317124 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 1 07:35:07 2022] GET /compute/v2.1/os-services => generated 794 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:35:08.159491 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-adc68a0c-541b-453b-a1bd-685fa91c6f56 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:35:08.160530 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-adc68a0c-541b-453b-a1bd-685fa91c6f56 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 01 07:35:08.160970 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:35:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:35:08.357584 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-deae1ded-fe92-4460-9fef-f5301f4030b8 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:35:08.360074 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:35:08.360074 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: warnings.warn(msg) Aug 01 07:35:08.361260 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-deae1ded-fe92-4460-9fef-f5301f4030b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:35:08.361696 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-deae1ded-fe92-4460-9fef-f5301f4030b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:35:08.362475 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-deae1ded-fe92-4460-9fef-f5301f4030b8 admin admin] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:35:08.362900 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-deae1ded-fe92-4460-9fef-f5301f4030b8 admin admin] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:35:08.382154 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-deae1ded-fe92-4460-9fef-f5301f4030b8 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078308 Aug 01 07:35:08.382638 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 1 07:35:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:35:19.631411 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-adc68a0c-541b-453b-a1bd-685fa91c6f56 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:35:19.632415 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-adc68a0c-541b-453b-a1bd-685fa91c6f56 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001729 Aug 01 07:35:19.632801 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:35:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:35:19.777231 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writing DB stats nova_cell0:SELECT=4 {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:35:19.777939 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writing DB stats nova_cell1:SELECT=4 {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:35:19.778556 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG dbcounter [-] [103321] Writing DB stats nova_api:SELECT=8 {{(pid=103321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:35:19.827543 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-f19c614d-412a-40c6-bf64-7868ccd2b510 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:35:19.829896 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:35:19.829896 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: warnings.warn(msg) Aug 01 07:35:19.831123 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-f19c614d-412a-40c6-bf64-7868ccd2b510 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:35:19.831563 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-f19c614d-412a-40c6-bf64-7868ccd2b510 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:35:19.832336 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-f19c614d-412a-40c6-bf64-7868ccd2b510 admin admin] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:35:19.832756 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-f19c614d-412a-40c6-bf64-7868ccd2b510 admin admin] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:35:19.857722 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-f19c614d-412a-40c6-bf64-7868ccd2b510 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085038 Aug 01 07:35:19.858281 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 1 07:35:19 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:35:20.679942 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: DEBUG nova.api.openstack.wsgi [None req-adc68a0c-541b-453b-a1bd-685fa91c6f56 admin admin] Calling method '>' {{(pid=103322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:35:20.681017 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: INFO nova.api.openstack.requestlog [None req-adc68a0c-541b-453b-a1bd-685fa91c6f56 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 01 07:35:20.681422 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: [pid: 103322|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 1 07:35:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:35:20.871812 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG nova.api.openstack.wsgi [None req-031f8c31-a062-4533-85b4-b9d79ba88f33 admin admin] Calling method '>' {{(pid=103321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:35:20.874174 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:35:20.874174 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: warnings.warn(msg) Aug 01 07:35:20.875389 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-031f8c31-a062-4533-85b4-b9d79ba88f33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:35:20.875835 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-031f8c31-a062-4533-85b4-b9d79ba88f33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:35:20.876623 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-031f8c31-a062-4533-85b4-b9d79ba88f33 admin admin] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:35:20.877059 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: DEBUG oslo_concurrency.lockutils [None req-031f8c31-a062-4533-85b4-b9d79ba88f33 admin admin] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:35:20.899334 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: INFO nova.api.openstack.requestlog [None req-031f8c31-a062-4533-85b4-b9d79ba88f33 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079829 Aug 01 07:35:20.899822 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: [pid: 103321|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 1 07:35:20 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:36:18.881223 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: Mon Aug 1 07:36:18 2022 - graceful shutdown triggered... Aug 01 07:36:18.881360 dv-cinder-733062-31-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 07:36:18.882274 dv-cinder-733062-31-iscsi devstack@n-api.service[103322]: Gracefully killing worker 2 (pid: 103322)... Aug 01 07:36:18.882686 dv-cinder-733062-31-iscsi devstack@n-api.service[103321]: Gracefully killing worker 1 (pid: 103321)... Aug 01 07:36:19.883445 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: worker 1 buried after 1 seconds Aug 01 07:36:19.883445 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: worker 2 buried after 1 seconds Aug 01 07:36:19.883445 dv-cinder-733062-31-iscsi devstack@n-api.service[103320]: goodbye to uWSGI. Aug 01 07:36:19.885007 dv-cinder-733062-31-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 07:36:19.885556 dv-cinder-733062-31-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 07:36:19.888438 dv-cinder-733062-31-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 07:36:19.897399 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 07:36:19.900409 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 07:36:19 2022] *** Aug 01 07:36:19.900563 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 07:36:19.900707 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 07:36:19.900825 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: nodename: dv-cinder-733062-31-iscsi Aug 01 07:36:19.900937 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: machine: x86_64 Aug 01 07:36:19.901060 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: clock source: unix Aug 01 07:36:19.901177 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: pcre jit disabled Aug 01 07:36:19.901293 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: detected number of CPU cores: 4 Aug 01 07:36:19.901413 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: current working directory: / Aug 01 07:36:19.901523 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: detected binary path: /usr/bin/uwsgi-core Aug 01 07:36:19.901638 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: your processes number limit is 47680 Aug 01 07:36:19.901765 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: your memory page size is 4096 bytes Aug 01 07:36:19.901765 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: detected max file descriptor number: 2048 Aug 01 07:36:19.901765 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: lock engine: pthread robust mutexes Aug 01 07:36:19.902032 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: thunder lock: enabled Aug 01 07:36:19.902103 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 07:36:19.902178 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 07:36:19.944902 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: Python main interpreter initialized at 0x562fb095d9c0 Aug 01 07:36:19.944902 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: python threads support enabled Aug 01 07:36:19.944902 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: your server socket listen backlog is limited to 100 connections Aug 01 07:36:19.944902 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: your mercy for graceful operations on workers is 90 seconds Aug 01 07:36:19.945371 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 07:36:19.945371 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: *** Operational MODE: preforking *** Aug 01 07:36:19.945612 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: *** uWSGI is running in multiple interpreter mode *** Aug 01 07:36:19.945612 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: spawned uWSGI master process (pid: 124258) Aug 01 07:36:19.945820 dv-cinder-733062-31-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 07:36:19.946493 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: spawned uWSGI worker 1 (pid: 124279, cores: 1) Aug 01 07:36:19.946838 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: spawned uWSGI worker 2 (pid: 124280, cores: 1) Aug 01 07:36:19.951436 dv-cinder-733062-31-iscsi devstack@n-api.service[124258]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 07:36:20.616094 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 07:36:20.624513 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 07:36:21.779516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:36:21.779516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: from cryptography.utils import int_from_bytes Aug 01 07:36:21.780241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:36:21.780241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: from cryptography.utils import int_from_bytes Aug 01 07:36:21.780633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:36:21.780633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: from cryptography.utils import int_from_bytes Aug 01 07:36:21.780769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:36:21.780769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: from cryptography.utils import int_from_bytes Aug 01 07:36:24.199222 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 07:36:24.199807 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 07:36:24.200151 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 07:36:24.200370 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 07:36:24.200627 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 07:36:24.201008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.201332 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.201650 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.201967 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.202291 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.202596 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.202913 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.203255 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.203580 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.203838 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.204147 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.204467 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-31-iscsi {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.204635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 07:36:24.205020 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.205107 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 07:36:24.205274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.205430 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 07:36:24.205529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.205770 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 07:36:24.205875 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.206035 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 07:36:24.206139 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.206426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.206541 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.206739 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.206844 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.207109 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.207288 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.208855 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.209076 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.209324 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.209570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.209787 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.209996 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.210238 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.210485 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.210717 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.210939 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.211207 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.211439 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.211663 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.211995 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.212232 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.212441 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.212647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-31-iscsi {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.212864 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.213082 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.213297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.213538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.213753 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-31-iscsi {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.213937 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.214148 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.214307 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.214500 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.214644 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.214825 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.214972 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.215147 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.215308 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.215484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.215642 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.215817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.215967 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.216119 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.216278 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.216457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.216606 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.216747 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.216747 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.217061 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.217227 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.217382 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.217542 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.217746 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.217901 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.218992 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.219274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.219435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.219650 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.219798 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.219940 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.220094 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.220317 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.220475 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-31-iscsi {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.220640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.220783 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.220933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.221075 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.221222 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.221400 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.221558 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.221558 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.221846 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.221997 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.222139 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.222280 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.222458 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.222630 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.222783 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.222932 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.223146 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.223310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.223454 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.223652 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.223798 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.223944 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.224093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.224246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.224398 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.224556 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.224699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.224840 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.224988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.225137 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.225295 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.225439 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.225590 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.225741 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.225891 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.226041 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.226195 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.226353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.226496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.226647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.226791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.226939 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.227685 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.227893 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.228047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.228197 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.228741 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.229206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.229367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.229526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.229668 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.229811 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.229953 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.230105 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.230258 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.230453 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.230601 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.230752 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.230902 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.231059 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.232184 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.232365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.232655 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.232820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.232981 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.233127 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.233278 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.233521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.233682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.233834 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.233990 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.234142 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.234296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.234437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.234589 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.234731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.234885 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.235028 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.235207 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.235359 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.235507 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.235660 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.235812 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.235955 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.236101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.236254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.236404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.236569 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.236719 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.236868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.237017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.237166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.237166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.237446 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.237596 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.237745 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.237887 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.238034 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.238183 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.238334 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.238843 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.239033 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240061 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240175 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240338 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240412 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240564 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240641 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240717 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240887 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.240968 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241039 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241113 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241195 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241280 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241406 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241518 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241599 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241678 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241758 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241866 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.241952 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.242036 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.242107 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.242181 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.242251 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.242327 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.242397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.242478 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.242555 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.242654 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.243334 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.243476 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.243612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.243765 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.243855 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.243927 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244004 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244081 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244152 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244234 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244312 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244382 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244520 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244624 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244624 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244788 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244885 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.244959 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245081 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245251 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245321 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245398 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245398 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245615 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245691 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245768 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.245928 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246075 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246145 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246213 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246356 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246438 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246514 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246659 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246738 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.246808 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.246884 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.246958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.247035 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.248101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.248290 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.248447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.249010 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.249186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.249724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.249881 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.250045 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.250197 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.250349 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.250503 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.250647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.250788 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.250988 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.251165 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.251322 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.251466 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.251607 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.251758 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.251900 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.252049 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.252191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.252332 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.252483 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.252643 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.252796 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.252948 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.253106 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.253249 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.253396 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.253553 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.253696 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.253845 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.253995 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.254138 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.254297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.254449 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:36:24.254600 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.254748 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.254906 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.255108 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.255275 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.255671 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.255817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.255966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.256118 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.256280 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.256431 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.256592 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.256736 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.256736 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.257013 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.257155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.257297 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.257452 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.257594 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.257742 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.257884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.258025 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.258164 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.258351 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.258558 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.259265 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.259465 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.259946 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.260093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.260246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.260397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.260540 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.260683 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.260826 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.261032 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.261187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.261350 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.261507 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.261656 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.261799 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.261950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.262104 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.262256 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.262399 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.262549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.262692 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.262920 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.263100 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.263251 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.263406 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.263568 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.263721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.263721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.264017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.264161 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.264310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.264468 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.264623 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.264774 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.264774 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.265062 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.265259 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.265424 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.266169 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.266335 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.266491 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.266644 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.266796 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.266940 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.267117 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.267280 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.267424 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.267573 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.267725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.267886 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.268045 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.268233 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.268389 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.271728 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.271905 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.272072 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.272263 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.272413 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.272568 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.272721 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.272865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.273019 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.273183 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.273328 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.273485 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.273678 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.273836 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.274004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.274224 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.274479 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.274725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.274893 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.275042 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.275222 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.275376 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.275537 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.275681 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.275824 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.275980 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.276132 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.276275 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.276275 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.276546 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.276688 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.276843 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.276987 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.277129 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.277271 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.277426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.277569 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.277724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.277868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.278017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.278168 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.278311 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.278489 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.278713 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.278875 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.279025 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.279245 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.279404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.279557 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.279707 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.279855 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.280003 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.280153 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.280303 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.280455 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.280605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.280747 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.280895 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.281038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.281863 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.282044 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.282238 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.282397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.282549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.282693 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.282843 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.282997 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.283164 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.283319 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.283465 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.283607 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.283757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.283908 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.284061 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.284211 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.284211 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.284482 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.284639 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.284782 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.284942 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.285129 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.285281 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.285430 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.285596 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.285747 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.285897 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.286050 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.286225 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.286371 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.286527 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.286671 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.286820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.286971 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.287143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.287302 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.287446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.287587 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.287729 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.287927 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.288083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.288241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.288385 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.288535 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.288687 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.288830 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.288972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.289128 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.289271 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.289413 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.290146 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.290504 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.290769 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.290982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.291175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.291864 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.292103 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.292256 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.292399 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.292658 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.292817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.292962 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.293112 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.293255 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.293408 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.293570 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.293715 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.293865 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.294017 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.294161 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.294312 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.294463 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.294615 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.294774 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.294931 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.295096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.295312 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.295461 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.295614 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.295757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.295900 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.295900 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.296191 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.296336 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.296484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.296484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.296755 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.296905 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.297056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.297200 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.297937 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.298090 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.298241 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.298395 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.298545 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.298688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.298844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.298987 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.299403 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.299563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.299717 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.299913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.300083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.300231 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.300460 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.300623 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.300808 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.300969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.301114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.301305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.302167 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.302421 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.302572 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.302842 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.303004 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.303186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.303333 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.303486 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.303782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.303942 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.304094 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.304254 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.304400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.304550 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.304707 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.304867 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.305014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.305173 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.305927 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.306187 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.306453 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.306639 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.306793 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.306938 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.307146 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.307298 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.307454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.307609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.307754 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.307911 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.308087 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.308370 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.308545 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.308701 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.308845 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.308994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.309138 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.309280 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.309432 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.309584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.309729 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.309879 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.310030 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.310811 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.311220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.311379 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.311552 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.312563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.312725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.313007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.313174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.313326 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.313416 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.313508 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.313594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.313779 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.313871 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.313964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314051 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314219 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314324 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314418 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314504 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314588 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314671 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314764 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314861 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.314948 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.315038 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.315217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.315316 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.315426 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.315520 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.315612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.315612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.315780 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.315865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.315962 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316054 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316145 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316230 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316493 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316833 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.316924 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317109 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317201 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317286 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317375 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317468 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317561 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317561 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317820 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317905 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.317997 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.318083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.318166 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.318256 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.318351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.318443 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.318542 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.318628 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.318718 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.318822 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.318917 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.319011 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.319258 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.319353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.319438 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.319539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.319625 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.319715 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.319800 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.319890 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.319983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.320079 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.320171 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.320256 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.320339 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.320430 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.320527 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.320613 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.320697 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.321029 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.321166 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.321324 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.321497 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.321612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.321612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.321765 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.321949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.322375 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.322485 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.322589 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.322677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.322769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.322861 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.322946 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323076 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323179 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323269 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323353 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323443 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323627 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323627 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323787 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323878 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.323970 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324064 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324151 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324234 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324326 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324418 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324502 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324599 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324691 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.324782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325028 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325117 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325200 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325283 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325449 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325727 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.325910 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326001 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326177 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326546 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326813 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326906 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.326998 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.327105 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.327105 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.327282 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.327282 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.327488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.327583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.327668 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.327751 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.327840 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.327926 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328023 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328110 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328192 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328192 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328363 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328453 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328547 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328638 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328730 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328825 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.328917 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329107 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329274 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329548 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329821 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.329913 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330005 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330099 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330184 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330460 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330553 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330645 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330730 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.330911 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.331002 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.331251 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.331352 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.331446 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.331531 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.331622 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.331708 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.331708 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.331943 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.332017 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.332096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.332204 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.332522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.332630 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.332707 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.332786 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.332860 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.332931 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333021 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333167 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333247 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333320 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333391 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333474 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333845 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333915 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.333992 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334076 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334220 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334290 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334360 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334438 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334518 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334604 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334676 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334754 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334825 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334908 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.334986 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.335078 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.335165 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.335246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.335325 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.335415 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.335528 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.335625 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.335708 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.335780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.335857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.336012 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.336142 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.336221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.336293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.336364 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.336646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.336808 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.336952 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337087 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337207 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337294 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337452 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337532 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337766 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337766 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337766 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.337766 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.338015 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.338095 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.338175 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.338260 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.338334 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.338404 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.338474 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343106 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343236 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343434 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343508 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343587 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343665 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343836 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343909 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.343985 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344063 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344063 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344063 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344063 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344063 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344399 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344517 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344601 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344680 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344753 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344829 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344906 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.344977 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345047 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345125 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345197 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345342 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345413 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345489 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345573 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345645 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345715 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345785 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345785 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.345923 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346002 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346073 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346142 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346219 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346376 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346456 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346532 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346609 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346680 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346828 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.346961 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.347088 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.347584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.347730 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.347730 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.347889 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.347970 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.348048 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.348280 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.348385 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.348602 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.348697 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.348924 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.349014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.349241 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.349342 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.349557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.349656 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.349870 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.349961 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.350179 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.350270 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.350522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.350620 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.350834 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.350933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.351177 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.351282 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.351499 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.351604 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.351807 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.351907 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.352704 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.352849 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.352998 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.353105 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.353318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.353445 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.353640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.353758 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.353960 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.354060 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.354268 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.354359 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.354588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.354688 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.354895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.354994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.355238 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.355333 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.355561 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.355671 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.355877 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.355977 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.356210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.356310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.356531 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.356633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.356848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.356947 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.357168 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.357260 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.357484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.357596 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.357802 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.357902 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.358119 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.358219 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.358462 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.358583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.358776 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.358887 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.359104 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.359216 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.359435 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.359539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.359760 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.359855 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.360073 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.360182 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.360387 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.360489 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.360691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.360786 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.361014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.361124 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.361336 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.361488 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.361650 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.361795 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.361971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.362138 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.362383 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.362484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.362773 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.362884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.363058 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.363245 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.363355 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.363484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.363682 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.363794 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.363989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.364083 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.364294 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.364386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.364605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.364706 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.364907 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.364997 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.365212 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.365312 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.365533 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.365646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.365855 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.365957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.366148 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.366271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.366456 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.366587 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.366768 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.367016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.367128 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.367362 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.367468 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.367713 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.367826 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.368550 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.368736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.368852 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.369003 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.369206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.369333 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.369542 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.369693 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.369845 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.369992 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.370138 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.370279 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.370425 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.370589 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.370741 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.370903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.371045 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.371276 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.371381 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.371603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.371710 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.371921 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.372012 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.372251 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.372349 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.372577 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.372682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.372899 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.373040 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.373227 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.373318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.373538 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.373639 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.373871 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.373978 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.374199 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.374299 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.374514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.374607 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.374831 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.374930 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.375206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.375317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.375511 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.375610 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.375813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.375904 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.376121 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.376222 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.376422 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.376515 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.376729 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.376831 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.377031 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.377137 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.377337 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.377431 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.377636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.377763 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.377937 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.378067 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.378236 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.378336 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.378564 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.378680 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.378857 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.378988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.379214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.379323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.379526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.379626 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.379831 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.379937 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.380136 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.380228 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.380691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.380788 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.381030 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.381123 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.381332 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.381431 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.381664 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.381755 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.381979 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.382073 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.382294 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.382393 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.382608 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.382701 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.382915 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.383060 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.383296 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.383434 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.383630 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.383741 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.384041 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.384134 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.384385 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.384484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.384711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.384814 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.385034 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.385126 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.385349 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.385444 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.385661 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.385767 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.385971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.386062 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.386284 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.386383 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.386598 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.386700 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.386918 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.387018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.387263 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.387509 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.387610 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.387836 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.387937 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.388149 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.388248 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.388460 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.388567 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.388770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.388862 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.389082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.389185 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.389389 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.389500 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.389694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.389786 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.390000 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.390099 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.390309 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.390414 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.390616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.390709 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.390935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.391033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.391279 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.391401 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.391592 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.391685 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.391923 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.392022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.392238 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.392332 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.392552 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.392650 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.392867 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.393033 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.393174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.393287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.393522 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.393616 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.393832 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.393942 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.394137 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.394231 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.394447 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.394541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.394761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.394922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.395098 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.395195 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.395402 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.395496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.395712 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.395813 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.396023 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.396126 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.396333 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.396425 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.396642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.396743 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.396956 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.397055 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.397269 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.397360 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.397581 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.397675 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.397903 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.398139 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.398238 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.398477 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.398586 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.398805 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.398935 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.399192 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.399345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.399507 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.399672 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.399980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.400193 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.400298 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.400508 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.400622 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.400836 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.400929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.401159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.401260 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.401482 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.401588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.401798 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.401922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.402111 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.402205 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.402437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.402605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.402743 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.402836 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.403050 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.403223 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.403383 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.403490 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.403690 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.403783 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.403993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.404089 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.404316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.404441 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.404627 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.404766 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.404930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.405082 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.405246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.405405 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.405552 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.405729 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.406054 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.406155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.406374 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.406473 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.406694 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.406793 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.407015 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.407155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.407364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.407458 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.407682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.407774 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.407987 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.408092 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.408312 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.408409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.408615 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.408714 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.408921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.409021 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.409235 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.409327 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.409544 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.409637 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.409847 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.409940 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.410151 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.410242 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.410461 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.410559 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.410767 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.411058 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.411184 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.411381 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.411474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.411681 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.411785 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.412005 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.412096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.412308 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.412408 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.412613 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.412711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.412915 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.413009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.413229 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.413345 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.413536 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.413637 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.413837 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.413970 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.414142 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.414237 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.414444 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.415042 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.415300 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.415395 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.415607 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.415700 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.415915 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.416015 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.416218 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.416310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.416542 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.416688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.416830 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.416948 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.417138 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.417429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.417521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.417791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.417884 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.418094 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.418197 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.418397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.418496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.418712 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.418817 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.419096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.419200 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.419428 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.419525 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.419746 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.419840 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.420056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.420150 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.420370 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.420471 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.420696 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.420796 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.421017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.421332 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.421430 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.421649 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.421742 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.421970 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.422062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.422289 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.422381 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.422604 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.422698 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.422910 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.423010 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.423244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.423459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.423591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.423703 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.423864 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.424014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.424174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.424278 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.424484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.424584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.424792 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.424892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.425102 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.425208 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.425407 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.425508 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.425714 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.425807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.426022 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.426126 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.426329 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.426429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.426635 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.426727 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.426943 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.427047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.427275 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.427369 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.427585 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.427686 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.427891 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.427985 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.428198 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.428296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.428509 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.428609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.428848 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.428949 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.429165 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.429257 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.429477 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.429569 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.429790 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.429897 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.430103 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.430245 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.431002 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.431137 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.431344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.431437 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.431652 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.431744 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.431960 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.432067 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.432272 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.432365 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.432598 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.432895 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.432996 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.433201 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.433346 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.433568 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.433671 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.433911 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.434007 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.434226 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.434356 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.434542 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.434634 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.434848 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.434950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.435188 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.435284 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.435510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.435604 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.435818 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.435925 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.436136 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.436230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.436446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.436545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.436763 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.436863 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.437082 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.437181 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.437402 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.437495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.437721 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.437815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.438022 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.438121 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.438329 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.438421 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.438633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.438735 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.438941 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.439033 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.439283 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.439386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.439593 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.439694 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.439895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.439987 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.440197 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.440297 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.440505 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.440604 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.440806 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.440898 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.441107 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.441212 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.441408 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.441507 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.441710 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.441801 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.442014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.442114 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.442312 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.442412 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.442612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.442711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.442912 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.443018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.443238 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.443361 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.443540 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.443688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.443840 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.443996 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.444145 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.444312 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.444446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.444738 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.444846 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.445055 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.445158 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.445371 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.445463 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.445672 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.445810 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.446048 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.446205 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.446382 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.446553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.446714 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.446870 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.447035 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.447217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.447388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.447535 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.447709 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.447855 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.448048 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.448163 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.448400 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.448501 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.448740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.448841 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.449075 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.449169 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.449434 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.449538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.449702 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.449801 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.450014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.450115 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.450322 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.450427 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.450633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.450732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.450939 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.451031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.451274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.451381 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.451583 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.451675 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.451903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.452001 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.452218 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.452320 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.452519 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.452618 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.452832 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.452923 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.453146 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.453247 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.453461 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.453553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.453769 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.453868 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.454076 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.454207 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.454387 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.454486 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.454693 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.454784 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.454998 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.455128 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.455330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.455423 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.455637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.455776 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.455941 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.456033 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.456249 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.456340 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.456554 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.456659 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.456860 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.456959 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.457170 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.457267 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.457486 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.457597 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.457807 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.457906 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.458128 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.458219 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.458434 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.458589 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.458757 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.458857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.459119 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.459227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.459416 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.459515 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.459740 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.459878 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.460070 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.460162 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.460390 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.460496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.460698 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.460790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.461005 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.461097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.461306 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.461452 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.461678 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 07:36:24.461772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.461999 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.462319 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.462640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.462959 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.463319 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.463652 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.463969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.464304 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.464629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.464957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.465281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.465598 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.465936 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.466256 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.466576 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.466894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.467243 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.467565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.467888 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.468205 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.468524 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.468848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.469170 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.469507 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.469841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.470161 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.470496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.470833 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.471217 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.471542 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.471893 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.472232 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.472554 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.472873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.473188 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:36:24.473441 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 07:36:24.527105 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO dbcounter [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Registered counter for database nova_api Aug 01 07:36:24.536118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO dbcounter [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Registered counter for database nova_api Aug 01 07:36:24.548034 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_db.sqlalchemy.engines [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:36:24.555299 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writer thread running {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:36:24.557006 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_db.sqlalchemy.engines [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:36:24.563726 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writer thread running {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:36:24.613056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.context [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc6ae24f-0fe6-4fae-ac28-8855099a2e0b(cell1) {{(pid=124279) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 07:36:24.617569 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:36:24.620196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:36:24.621013 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:36:24.621824 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.context [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc6ae24f-0fe6-4fae-ac28-8855099a2e0b(cell1) {{(pid=124280) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 07:36:24.623099 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:36:24.625101 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO dbcounter [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Registered counter for database nova_cell0 Aug 01 07:36:24.625935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:36:24.628711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:36:24.629153 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO dbcounter [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Registered counter for database nova_cell1 Aug 01 07:36:24.629517 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:36:24.631836 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:36:24.633924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO dbcounter [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Registered counter for database nova_cell0 Aug 01 07:36:24.636751 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_db.sqlalchemy.engines [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:36:24.638184 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO dbcounter [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Registered counter for database nova_cell1 Aug 01 07:36:24.639145 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_db.sqlalchemy.engines [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:36:24.644317 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writer thread running {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:36:24.645495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_db.sqlalchemy.engines [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:36:24.647724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_db.sqlalchemy.engines [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:36:24.650515 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writer thread running {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:36:24.653582 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writer thread running {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:36:24.656280 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writer thread running {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:36:24.799536 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO dbcounter [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Registered counter for database nova_cell0 Aug 01 07:36:24.808154 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_db.sqlalchemy.engines [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:36:24.808344 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO dbcounter [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Registered counter for database nova_cell0 Aug 01 07:36:24.812769 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writer thread running {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:36:24.814750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_db.sqlalchemy.engines [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:36:24.819151 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writer thread running {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:36:25.139958 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: WARNING keystonemiddleware.auth_token [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:36:25.140156 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: WARNING keystonemiddleware.auth_token [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:36:25.147285 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: WARNING keystonemiddleware.auth_token [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:36:25.147624 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: WARNING keystonemiddleware.auth_token [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:36:25.492472 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: WARNING keystonemiddleware.auth_token [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:36:25.494954 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: WARNING keystonemiddleware.auth_token [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:36:25.499346 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: WARNING keystonemiddleware.auth_token [None req-a34be2b0-d0dd-4a2a-8d55-be42fc36ac76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:36:25.501152 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: WARNING keystonemiddleware.auth_token [None req-08a54a1b-c84e-42f3-8df7-befcec0e27b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:36:25.506206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562fb095d9c0 pid: 124280 (default app) Aug 01 07:36:25.506766 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562fb095d9c0 pid: 124279 (default app) Aug 01 07:37:06.396338 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=3 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:06.397422 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=3 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:06.399418 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=3 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:06.400226 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=3 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:06.871554 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:06.874482 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:06.875452 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:06.877438 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:08.517029 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-15fe1885-da4d-4670-95e4-0e963fe95ebd tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Action: 'create', calling method: .version_select at 0x7fd01a9b6f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-890636730", "metadata": {"Type": "work"}}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-15fe1885-da4d-4670-95e4-0e963fe95ebd tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Request method failure captured: Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 121 Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KiKvOXEEN5cXvZ11yVZ_s8rZ5whglZ_2hoq3Q53y7KQr7t2hqYQcK0wUqOO5ybKp99tQMSbxUBs1MLNn6LeJk3g2BSFONbScIl8MyF35Qa854Ubqo5to6HzSZdNIxPMbuJZ7Cj_M1_36QNEzBJswQ3uzMYQnrFzoDI8U2_rJp5b0E Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:37:08.531982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: f38a13230b0e4baab9148a2e20bbe73b Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-890636730", "metadata": {"Type": "work"}}} Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: Aug 01 07:37:08.533603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-890636730', 'metadata': {'Type': 'work'}}}} Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise error Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:37:08.534578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 07:37:08.536483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 07:37:08.538501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 07:37:08.538501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.540855 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-15fe1885-da4d-4670-95e4-0e963fe95ebd tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:37:08.542156 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-15fe1885-da4d-4670-95e4-0e963fe95ebd tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.172390 Aug 01 07:37:08.552338 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Aug 1 07:37:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 07:37:08.564853 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4a8c49cb-9643-48e6-a785-8fbe30d86f95 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Action: 'create', calling method: .version_select at 0x7fd01a8c8af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1143682151", "metadata": {"Type": "work"}}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4a8c49cb-9643-48e6-a785-8fbe30d86f95 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Request method failure captured: Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 120 Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KiKvOXEEN5cXvZ11yVZ_s8rZ5whglZ_2hoq3Q53y7KQr7t2hqYQcK0wUqOO5ybKp99tQMSbxUBs1MLNn6LeJk3g2BSFONbScIl8MyF35Qa854Ubqo5to6HzSZdNIxPMbuJZ7Cj_M1_36QNEzBJswQ3uzMYQnrFzoDI8U2_rJp5b0E Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:37:08.575189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: f38a13230b0e4baab9148a2e20bbe73b Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1143682151", "metadata": {"Type": "work"}}} Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: Aug 01 07:37:08.576672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1143682151', 'metadata': {'Type': 'work'}}}} Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise error Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi '0' Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:37:08.577447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 07:37:08.578781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 07:37:08.580164 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 07:37:08.580164 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.580164 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4a8c49cb-9643-48e6-a785-8fbe30d86f95 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:37:08.582826 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4a8c49cb-9643-48e6-a785-8fbe30d86f95 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025939 Aug 01 07:37:08.584422 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 2/2] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Aug 1 07:37:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 07:37:08.596107 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9aae014f-8001-48e5-91da-bff90a748e27 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Action: 'create', calling method: .version_select at 0x7fd01a887af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1597763714", "metadata": {"Type": "work"}}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9aae014f-8001-48e5-91da-bff90a748e27 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Request method failure captured: Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 119 Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KiKvOXEEN5cXvZ11yVZ_s8rZ5whglZ_2hoq3Q53y7KQr7t2hqYQcK0wUqOO5ybKp99tQMSbxUBs1MLNn6LeJk3g2BSFONbScIl8MyF35Qa854Ubqo5to6HzSZdNIxPMbuJZ7Cj_M1_36QNEzBJswQ3uzMYQnrFzoDI8U2_rJp5b0E Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:37:08.608388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: f38a13230b0e4baab9148a2e20bbe73b Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1597763714", "metadata": {"Type": "work"}}} Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: Aug 01 07:37:08.609924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1597763714', 'metadata': {'Type': 'work'}}}} Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise error Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi '' Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:37:08.610848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 07:37:08.612505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 07:37:08.613836 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 07:37:08.613836 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:08.615814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9aae014f-8001-48e5-91da-bff90a748e27 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:37:08.629058 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9aae014f-8001-48e5-91da-bff90a748e27 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.038368 Aug 01 07:37:08.633166 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 3/3] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Aug 1 07:37:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 07:37:08.647262 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3953fc16-723f-4a6a-ac1a-62b7b508b87d tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Calling method '.version_select at 0x7fd01a887820>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:08.703358 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c2592c72-8530-4dd4-9b78-2c871ee82dd2 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Action: 'create', calling method: .version_select at 0x7fd01a9b6ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1505571744"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:09.493534 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-3953fc16-723f-4a6a-ac1a-62b7b508b87d tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] HTTP exception thrown: Volume tempest-invalid-2089564835 could not be found. Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3953fc16-723f-4a6a-ac1a-62b7b508b87d tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Request method failure captured: Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2089564835 HTTP/1.1 Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KiKvOXEEN5cXvZ11yVZ_s8rZ5whglZ_2hoq3Q53y7KQr7t2hqYQcK0wUqOO5ybKp99tQMSbxUBs1MLNn6LeJk3g2BSFONbScIl8MyF35Qa854Ubqo5to6HzSZdNIxPMbuJZ7Cj_M1_36QNEzBJswQ3uzMYQnrFzoDI8U2_rJp5b0E Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:37:09.497373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: f38a13230b0e4baab9148a2e20bbe73b Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Volume tempest-invalid-2089564835 could not be found. Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'tempest-invalid-2089564835'} Aug 01 07:37:09.498894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2089564835 could not be found. (HTTP 404) (Request-ID: req-76611e17-79de-4e42-ad3f-5475d91dadd9) Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:09.499742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 07:37:09.501097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2089564835 could not be found. Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:37:09.503588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2089564835 could not be found. Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2089564835 could not be found. Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3953fc16-723f-4a6a-ac1a-62b7b508b87d tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Returning 404 to user: Volume tempest-invalid-2089564835 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:37:09.504803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3953fc16-723f-4a6a-ac1a-62b7b508b87d tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2089564835" status: 404 len: 99 microversion: 2.1 time: 0.860960 Aug 01 07:37:09.506133 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 4/4] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Aug 1 07:37:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2089564835 => generated 99 bytes in 868 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 07:37:09.512772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6b6b55c6-18a1-4ee2-839c-ccfa2c1dd861 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004017 Aug 01 07:37:09.518447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 5/5] 10.222.0.40 () {58 vars in 1140 bytes} [Mon Aug 1 07:37:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 01 07:37:09.523689 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-06fbcf31-3a29-4055-a38b-87289f905692 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003712 Aug 01 07:37:09.536363 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 6/6] 10.222.0.40 () {58 vars in 1137 bytes} [Mon Aug 1 07:37:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 07:37:09.556201 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d3927151-58d4-4104-bde9-ee89e71c7a12 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Calling method '.version_select at 0x7fd01a7badc0>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:09.755608 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-d3927151-58d4-4104-bde9-ee89e71c7a12 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] HTTP exception thrown: Volume d3f42f54-0223-4303-a226-a38477af10aa could not be found. Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d3927151-58d4-4104-bde9-ee89e71c7a12 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Request method failure captured: Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/os-volumes/d3f42f54-0223-4303-a226-a38477af10aa HTTP/1.1 Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KiKvOXEEN5cXvZ11yVZ_s8rZ5whglZ_2hoq3Q53y7KQr7t2hqYQcK0wUqOO5ybKp99tQMSbxUBs1MLNn6LeJk3g2BSFONbScIl8MyF35Qa854Ubqo5to6HzSZdNIxPMbuJZ7Cj_M1_36QNEzBJswQ3uzMYQnrFzoDI8U2_rJp5b0E Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:37:09.757647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: f38a13230b0e4baab9148a2e20bbe73b Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Volume d3f42f54-0223-4303-a226-a38477af10aa could not be found. Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'd3f42f54-0223-4303-a226-a38477af10aa'} Aug 01 07:37:09.759016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d3f42f54-0223-4303-a226-a38477af10aa could not be found. (HTTP 404) (Request-ID: req-66a3e70e-3003-44d2-b6c7-4831f4a7569e) Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:09.768768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 07:37:09.770913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d3f42f54-0223-4303-a226-a38477af10aa could not be found. Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 07:37:09.774210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d3f42f54-0223-4303-a226-a38477af10aa could not be found. Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d3f42f54-0223-4303-a226-a38477af10aa could not be found. Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d3927151-58d4-4104-bde9-ee89e71c7a12 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Returning 404 to user: Volume d3f42f54-0223-4303-a226-a38477af10aa could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d3927151-58d4-4104-bde9-ee89e71c7a12 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/d3f42f54-0223-4303-a226-a38477af10aa" status: 404 len: 109 microversion: 2.1 time: 0.221679 Aug 01 07:37:09.777310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 7/7] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 1 07:37:09 2022] DELETE /compute/v2.1/os-volumes/d3f42f54-0223-4303-a226-a38477af10aa => generated 109 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:37:09.779466 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-147485ff-74be-43dd-b5cc-ba3b9d0fbf04 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Calling method '.version_select at 0x7fd01a8a5820>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:10.649652 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-147485ff-74be-43dd-b5cc-ba3b9d0fbf04 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] HTTP exception thrown: Volume 6bbb8b5d-6057-4134-8f23-4dbae65025c7 could not be found. Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-147485ff-74be-43dd-b5cc-ba3b9d0fbf04 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Request method failure captured: Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/os-volumes/6bbb8b5d-6057-4134-8f23-4dbae65025c7 HTTP/1.1 Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KiKvOXEEN5cXvZ11yVZ_s8rZ5whglZ_2hoq3Q53y7KQr7t2hqYQcK0wUqOO5ybKp99tQMSbxUBs1MLNn6LeJk3g2BSFONbScIl8MyF35Qa854Ubqo5to6HzSZdNIxPMbuJZ7Cj_M1_36QNEzBJswQ3uzMYQnrFzoDI8U2_rJp5b0E Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:37:10.652300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f0667d27d174403b879f4c13a318fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 2f0667d27d174403b879f4c13a318fa3 Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-VolumesNegativeTest-1245953565 Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: f38a13230b0e4baab9148a2e20bbe73b Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-VolumesNegativeTest-1245953565-project Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Volume 6bbb8b5d-6057-4134-8f23-4dbae65025c7 could not be found. Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '6bbb8b5d-6057-4134-8f23-4dbae65025c7'} Aug 01 07:37:10.653736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bbb8b5d-6057-4134-8f23-4dbae65025c7 could not be found. (HTTP 404) (Request-ID: req-5e4eac86-28ad-401d-93ac-09a03dada584) Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:10.654667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 07:37:10.656020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bbb8b5d-6057-4134-8f23-4dbae65025c7 could not be found. Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 07:37:10.657169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bbb8b5d-6057-4134-8f23-4dbae65025c7 could not be found. Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bbb8b5d-6057-4134-8f23-4dbae65025c7 could not be found. Aug 01 07:37:10.658252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:10.660888 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-147485ff-74be-43dd-b5cc-ba3b9d0fbf04 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] Returning 404 to user: Volume 6bbb8b5d-6057-4134-8f23-4dbae65025c7 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:37:10.661977 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-147485ff-74be-43dd-b5cc-ba3b9d0fbf04 tempest-VolumesNegativeTest-1245953565 tempest-VolumesNegativeTest-1245953565-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6bbb8b5d-6057-4134-8f23-4dbae65025c7" status: 404 len: 109 microversion: 2.1 time: 0.892673 Aug 01 07:37:10.663289 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 8/8] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:37:09 2022] GET /compute/v2.1/os-volumes/6bbb8b5d-6057-4134-8f23-4dbae65025c7 => generated 109 bytes in 894 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 07:37:10.821029 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c2592c72-8530-4dd4-9b78-2c871ee82dd2 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.956040 Aug 01 07:37:10.823441 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 1/9] 10.222.0.40 () {60 vars in 1155 bytes} [Mon Aug 1 07:37:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3962 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 07:37:10.836480 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4ebda28f-130d-4d41-a55f-d3ca03a86a86 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a8879d0>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:10.981483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4ebda28f-130d-4d41-a55f-d3ca03a86a86 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48" status: 200 len: 345 microversion: 2.1 time: 0.149463 Aug 01 07:37:10.982052 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 9/10] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:37:10 2022] GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:11.996366 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-70509f50-15cd-4a1e-a5de-896a8b77d9b6 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a83ad30>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:12.157817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-70509f50-15cd-4a1e-a5de-896a8b77d9b6 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48" status: 200 len: 346 microversion: 2.1 time: 0.165953 Aug 01 07:37:12.159408 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 2/11] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:37:11 2022] GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 => generated 346 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:12.172081 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-562fa172-1ef3-466d-9f67-b2f8371f25b8 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Action: 'create', calling method: .version_select at 0x7fd01a7ba310>, body: {"snapshot": {"volume_id": "c6e3e7cb-79b5-4f99-9c31-a6f78c197b48", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-839178673"}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:12.624687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-562fa172-1ef3-466d-9f67-b2f8371f25b8 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.456269 Aug 01 07:37:12.625399 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 10/12] 10.222.0.40 () {60 vars in 1162 bytes} [Mon Aug 1 07:37:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:12.636858 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-495d59d6-3a67-4053-87e8-13506e140f85 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a84a430>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:12.730672 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-495d59d6-3a67-4053-87e8-13506e140f85 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf" status: 200 len: 286 microversion: 2.1 time: 0.097774 Aug 01 07:37:12.731822 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 3/13] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 1 07:37:12 2022] GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:12.743090 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2cf0f74c-3b0a-4aa5-af42-c58b4ad63106 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a7d6af0>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:13.036802 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2cf0f74c-3b0a-4aa5-af42-c58b4ad63106 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.298446 Aug 01 07:37:13.038436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 11/14] 10.222.0.40 () {58 vars in 1140 bytes} [Mon Aug 1 07:37:12 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:13.050446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b894242b-fc39-4859-a3dd-dda5f73cb043 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a84ab80>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:13.125798 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b894242b-fc39-4859-a3dd-dda5f73cb043 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf" status: 200 len: 286 microversion: 2.1 time: 0.079688 Aug 01 07:37:13.130042 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 4/15] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 1 07:37:13 2022] GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:14.141040 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-eaef2a3d-78d3-4cba-beb4-ecffd4c5d151 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a7d6700>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:14.244264 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-eaef2a3d-78d3-4cba-beb4-ecffd4c5d151 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf" status: 200 len: 286 microversion: 2.1 time: 0.108599 Aug 01 07:37:14.245113 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 12/16] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 1 07:37:14 2022] GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:15.259390 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b479657f-d6c3-4e27-a046-9774c599ac42 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a83ad30>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:15.341046 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b479657f-d6c3-4e27-a046-9774c599ac42 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf" status: 200 len: 286 microversion: 2.1 time: 0.087088 Aug 01 07:37:15.343930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 5/17] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 1 07:37:15 2022] GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:16.356864 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-82546753-1483-4bb3-b78b-b9862f569ae2 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a7bab80>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:16.425333 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-82546753-1483-4bb3-b78b-b9862f569ae2 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf" status: 200 len: 287 microversion: 2.1 time: 0.072615 Aug 01 07:37:16.432890 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 13/18] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 1 07:37:16 2022] GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:16.439548 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d741a8fa-f655-43c4-bb70-2188c1437c82 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a84aa60>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:16.608572 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d741a8fa-f655-43c4-bb70-2188c1437c82 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf" status: 202 len: 0 microversion: 2.1 time: 0.174169 Aug 01 07:37:16.609784 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 6/19] 10.222.0.40 () {58 vars in 1254 bytes} [Mon Aug 1 07:37:16 2022] DELETE /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:37:16.622523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4c78968a-6046-469d-a685-6e0d1e8ab358 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a84a310>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:16.733775 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4c78968a-6046-469d-a685-6e0d1e8ab358 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf" status: 200 len: 286 microversion: 2.1 time: 0.119858 Aug 01 07:37:16.738526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 7/20] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 1 07:37:16 2022] GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf => generated 286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:17.254982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c8c79adf-beb9-424d-b3d9-a21878a2d374 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'create', calling method: .version_select at 0x7fd01a7baa60>, body: {"keypair": {"name": "tempest-keypair-1399290897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFulsHtYGR3q5vgIYN3jV06zH5M/9743g5uQQYAkqA3tAmQcvkCV0l8vGl+mA7kIGQA97peuP0ZKSgVbWs+YLeGiV5+HIj1hUxRF7Ag0ll9E8IxnXFD4XCQUYSX1+smjqg=="}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:17.365560 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-c8c79adf-beb9-424d-b3d9-a21878a2d374 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Getting quotas for project 311edf4e3e534746bed2ff3a2888434d. Resources: {'key_pairs'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:37:17.375907 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-c8c79adf-beb9-424d-b3d9-a21878a2d374 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Getting quotas for user 5958b9f3a2c4424db419e7b1c667ca92 and project 311edf4e3e534746bed2ff3a2888434d. Resources: {'key_pairs'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:37:17.460458 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c8c79adf-beb9-424d-b3d9-a21878a2d374 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.915162 Aug 01 07:37:17.469450 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 14/21] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 1 07:37:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:17.749529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5b2faf2b-f565-48b4-aac1-0912e771e0f5 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a83adc0>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:18.079137 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-5b2faf2b-f565-48b4-aac1-0912e771e0f5 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] HTTP exception thrown: Snapshot 1abd33bb-e505-47d1-a97b-e697cc02acdf could not be found. Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5b2faf2b-f565-48b4-aac1-0912e771e0f5 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Request method failure captured: Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf HTTP/1.1 Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54Ki6yroQLWBV-VHoUNAvZjRnBT83jRRQDPehvt5UTbIh1YM5GILL7ncDWw_rJ2fGVMqZGzC6mq62gI6rL8qG8lNoNAuyc_8jeiLmlk6IgBGc1EtbutgC7z5MNQMluzNUtLZaYqQ16ZYfZscy98IzGma1xvcOkqztykMIhZUU0OXlnQ Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: a589760b9c674009a0ec8007d1669f12 Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:37:18.089335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a589760b9c674009a0ec8007d1669f12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: a589760b9c674009a0ec8007d1669f12 Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-VolumesSnapshotsTestJSON-1492859598-project Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: e4a248d79a3f4aa2b7937e566508e559 Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492859598-project Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Snapshot 1abd33bb-e505-47d1-a97b-e697cc02acdf could not be found. Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '1abd33bb-e505-47d1-a97b-e697cc02acdf'} Aug 01 07:37:18.090616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1abd33bb-e505-47d1-a97b-e697cc02acdf could not be found. (HTTP 404) (Request-ID: req-48f0edab-0d9a-4b0c-8708-3f7cb86cbe75) Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:18.091310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 07:37:18.092316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1abd33bb-e505-47d1-a97b-e697cc02acdf could not be found. Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 07:37:18.093350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1abd33bb-e505-47d1-a97b-e697cc02acdf could not be found. Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1abd33bb-e505-47d1-a97b-e697cc02acdf could not be found. Aug 01 07:37:18.094365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:18.094937 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5b2faf2b-f565-48b4-aac1-0912e771e0f5 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Returning 404 to user: Snapshot 1abd33bb-e505-47d1-a97b-e697cc02acdf could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:37:18.097097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5b2faf2b-f565-48b4-aac1-0912e771e0f5 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf" status: 404 len: 111 microversion: 2.1 time: 0.353773 Aug 01 07:37:18.101158 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 8/22] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 1 07:37:17 2022] GET /compute/v2.1/os-snapshots/1abd33bb-e505-47d1-a97b-e697cc02acdf => generated 111 bytes in 359 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 07:37:18.109751 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-50dffc8a-6a1a-443f-bf39-67b1bed61aae tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a7388b0>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:18.390423 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-50dffc8a-6a1a-443f-bf39-67b1bed61aae tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48" status: 202 len: 0 microversion: 2.1 time: 0.284604 Aug 01 07:37:18.391977 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 15/23] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 1 07:37:18 2022] DELETE /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:37:18.401759 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-dd4567c6-b4ac-4a22-a642-f24c93090eb0 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01b1bf430>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:18.514590 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-dd4567c6-b4ac-4a22-a642-f24c93090eb0 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48" status: 200 len: 345 microversion: 2.1 time: 0.118191 Aug 01 07:37:18.515698 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 9/24] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:37:18 2022] GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:37:19.529856 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0ca9048a-b34d-487c-bede-33e02913c085 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a738f70>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:19.659262 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-0ca9048a-b34d-487c-bede-33e02913c085 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] HTTP exception thrown: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0ca9048a-b34d-487c-bede-33e02913c085 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Request method failure captured: Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 HTTP/1.1 Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54Ki6yroQLWBV-VHoUNAvZjRnBT83jRRQDPehvt5UTbIh1YM5GILL7ncDWw_rJ2fGVMqZGzC6mq62gI6rL8qG8lNoNAuyc_8jeiLmlk6IgBGc1EtbutgC7z5MNQMluzNUtLZaYqQ16ZYfZscy98IzGma1xvcOkqztykMIhZUU0OXlnQ Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: a589760b9c674009a0ec8007d1669f12 Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:37:19.661750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a589760b9c674009a0ec8007d1669f12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: a589760b9c674009a0ec8007d1669f12 Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-VolumesSnapshotsTestJSON-1492859598-project Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: e4a248d79a3f4aa2b7937e566508e559 Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492859598-project Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'c6e3e7cb-79b5-4f99-9c31-a6f78c197b48'} Aug 01 07:37:19.663635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. (HTTP 404) (Request-ID: req-93818b33-ad3b-4f01-9db6-6434178b2153) Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:19.664265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 07:37:19.665178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 07:37:19.666120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0ca9048a-b34d-487c-bede-33e02913c085 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Returning 404 to user: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0ca9048a-b34d-487c-bede-33e02913c085 tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48" status: 404 len: 109 microversion: 2.1 time: 0.138742 Aug 01 07:37:19.667022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 16/25] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:37:19 2022] GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:37:19.681555 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-66cfd1c7-c758-44c8-bb8a-f8e68119081f tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a81a670>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:19.777059 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-66cfd1c7-c758-44c8-bb8a-f8e68119081f tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] HTTP exception thrown: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-66cfd1c7-c758-44c8-bb8a-f8e68119081f tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Request method failure captured: Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: DELETE /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 HTTP/1.1 Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54Ki6yroQLWBV-VHoUNAvZjRnBT83jRRQDPehvt5UTbIh1YM5GILL7ncDWw_rJ2fGVMqZGzC6mq62gI6rL8qG8lNoNAuyc_8jeiLmlk6IgBGc1EtbutgC7z5MNQMluzNUtLZaYqQ16ZYfZscy98IzGma1xvcOkqztykMIhZUU0OXlnQ Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: a589760b9c674009a0ec8007d1669f12 Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:37:19.779457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a589760b9c674009a0ec8007d1669f12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: a589760b9c674009a0ec8007d1669f12 Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-VolumesSnapshotsTestJSON-1492859598-project Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: e4a248d79a3f4aa2b7937e566508e559 Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492859598-project Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': 'c6e3e7cb-79b5-4f99-9c31-a6f78c197b48'} Aug 01 07:37:19.780488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. (HTTP 404) (Request-ID: req-7e786c91-ee4a-46cd-aef0-460ab906a6c1) Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:19.781116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 07:37:19.782083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 07:37:19.782949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-66cfd1c7-c758-44c8-bb8a-f8e68119081f tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Returning 404 to user: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-66cfd1c7-c758-44c8-bb8a-f8e68119081f tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48" status: 404 len: 109 microversion: 2.1 time: 0.105354 Aug 01 07:37:19.783921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 10/26] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 1 07:37:19 2022] DELETE /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:37:19.792193 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-533e522c-2883-48da-8ea1-715f0f33832f tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Calling method '.version_select at 0x7fd01a7388b0>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:19.984324 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-533e522c-2883-48da-8ea1-715f0f33832f tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] HTTP exception thrown: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-533e522c-2883-48da-8ea1-715f0f33832f tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Request method failure captured: Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 HTTP/1.1 Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54Ki6yroQLWBV-VHoUNAvZjRnBT83jRRQDPehvt5UTbIh1YM5GILL7ncDWw_rJ2fGVMqZGzC6mq62gI6rL8qG8lNoNAuyc_8jeiLmlk6IgBGc1EtbutgC7z5MNQMluzNUtLZaYqQ16ZYfZscy98IzGma1xvcOkqztykMIhZUU0OXlnQ Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: a589760b9c674009a0ec8007d1669f12 Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:37:19.987348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a589760b9c674009a0ec8007d1669f12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a589760b9c674009a0ec8007d1669f12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: a589760b9c674009a0ec8007d1669f12 Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492859598 Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-VolumesSnapshotsTestJSON-1492859598-project Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: e4a248d79a3f4aa2b7937e566508e559 Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492859598-project Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'c6e3e7cb-79b5-4f99-9c31-a6f78c197b48'} Aug 01 07:37:19.988617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. (HTTP 404) (Request-ID: req-11a5c38b-4cbb-4e33-940b-f791a98d7503) Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:19.989329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 07:37:19.990267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 07:37:19.992957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. Aug 01 07:37:19.994436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:37:19.997373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-533e522c-2883-48da-8ea1-715f0f33832f tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] Returning 404 to user: Volume c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:37:20.000024 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-533e522c-2883-48da-8ea1-715f0f33832f tempest-VolumesSnapshotsTestJSON-1492859598 tempest-VolumesSnapshotsTestJSON-1492859598-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48" status: 404 len: 109 microversion: 2.1 time: 0.213670 Aug 01 07:37:20.004462 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 17/27] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:37:19 2022] GET /compute/v2.1/os-volumes/c6e3e7cb-79b5-4f99-9c31-a6f78c197b48 => generated 109 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:37:22.773580 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1689817077", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:23.042983 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.network.neutron [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] validate_networks() for [('9823c1ef-0097-4726-b18e-20812226ba01', None, None, None, None, None)] {{(pid=124279) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:37:24.633318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-389577005", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "networks": [{"uuid": "b7da145a-9a7d-45b1-aca8-9cc776bf77db"}]}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:24.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] validate_networks() for [('b7da145a-9a7d-45b1-aca8-9cc776bf77db', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:37:26.326908 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:37:26.328245 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:37:26.328772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:37:26.329190 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:37:26.329967 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:37:26.345750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:26.346372 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:26.347506 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:26.348182 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:26.394875 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Flavor limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:37:26.395412 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Image limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:37:26.395937 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Flavor pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:37:26.397177 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Image pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:37:26.397429 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:37:26.417676 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Getting quotas for project 53bab4dbf0c34ae0be1be397427c99e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:37:26.422735 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:26.424060 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:26.426576 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:26.428617 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:26.428931 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Getting quotas for user 905e317fcf49428ea1fa708dfabc958e and project 53bab4dbf0c34ae0be1be397427c99e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:37:26.493854 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:37:26.510497 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:37:26.553802 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Getting quotas for project 015cc91d3e2f4d3791301c05e4c8be20. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:37:26.573796 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Getting quotas for user db6ac4cf9dd84e338f944b4905dcdb50 and project 015cc91d3e2f4d3791301c05e4c8be20. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:37:26.626159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Going to run 1 instances... {{(pid=124279) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:37:26.643978 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:37:26.705479 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-29c84bc7-b072-435a-8d75-21bbff982fce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.459620 Aug 01 07:37:26.717663 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 18/28] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:37:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 07:37:26.730633 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1618441773", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be198857-00fd-444b-ab8f-c786d2d86330"}], "security_groups": [{"name": "tempest-securitygroup--1309094898"}], "key_name": "tempest-keypair-1399290897", "user_data": "}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:26.913363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-144e7735-18e4-4a3f-a9de-f4df86e47052 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.382585 Aug 01 07:37:26.914767 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 11/29] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:37:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 4385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:37:27.065988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] validate_networks() for [('be198857-00fd-444b-ab8f-c786d2d86330', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:37:27.438733 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2bea59e2-378a-432f-aaa2-5cde903ee3e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Action: 'create', calling method: .version_select at 0x7fd019ec0700>, body: {"keypair": {"name": "tempest-keypair-1027807052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwYEdtD78Jn3iGxOzBpuBMchPfQ43w8giIXK5LkXgVpcscEFSwSrSEjlDrkQS2h5BGe8RlJgMAQd8Pon7JGlMZ9EEDR08BV2oVDjQML0x3/y94gCy06rpWNOeMkD6qhRQ=="}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:27.518212 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-2bea59e2-378a-432f-aaa2-5cde903ee3e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Getting quotas for project 4a2b83a4dad243e79144db87357d1897. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:37:27.531116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-2bea59e2-378a-432f-aaa2-5cde903ee3e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Getting quotas for user 1e02f414ef2a4990bd1492a63d074319 and project 4a2b83a4dad243e79144db87357d1897. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:37:27.620217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2bea59e2-378a-432f-aaa2-5cde903ee3e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.703368 Aug 01 07:37:27.625726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 12/30] 10.222.0.40 () {62 vars in 1200 bytes} [Mon Aug 1 07:37:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 710 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 07:37:27.637938 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bdc2aceb-b221-46be-a91b-d6a0f1ab53f3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:27.640846 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-bdc2aceb-b221-46be-a91b-d6a0f1ab53f3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:27.789414 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:37:27.790249 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:37:27.791020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:37:27.791683 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:37:27.792560 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:37:27.816711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:27.821123 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:27.823148 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:27.824645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:27.850840 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Getting quotas for project 311edf4e3e534746bed2ff3a2888434d. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:37:27.855957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Getting quotas for user 5958b9f3a2c4424db419e7b1c667ca92 and project 311edf4e3e534746bed2ff3a2888434d. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:37:27.874727 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:37:27.877365 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:37:27.886512 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bdc2aceb-b221-46be-a91b-d6a0f1ab53f3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:27.932871 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-bdc2aceb-b221-46be-a91b-d6a0f1ab53f3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1214 microversion: 2.1 time: 0.303363 Aug 01 07:37:27.933258 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 13/31] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:27 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1214 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:27.956383 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0a54cc23-9e24-431b-8343-4874a325245c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.236760 Aug 01 07:37:27.957661 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 19/32] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:37:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:37:27.969758 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-150a9683-55cb-4896-905e-4821257b809b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:27.970568 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-150a9683-55cb-4896-905e-4821257b809b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:28.013896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-51c459a5-dd21-476b-9b5c-b90977bdafcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:28.016669 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-51c459a5-dd21-476b-9b5c-b90977bdafcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:28.266889 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-150a9683-55cb-4896-905e-4821257b809b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:28.327208 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-150a9683-55cb-4896-905e-4821257b809b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1238 microversion: 2.1 time: 0.359767 Aug 01 07:37:28.330543 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 20/33] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:27 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1238 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:28.332877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-51c459a5-dd21-476b-9b5c-b90977bdafcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:28.348046 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-51c459a5-dd21-476b-9b5c-b90977bdafcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1222 microversion: 2.1 time: 0.373625 Aug 01 07:37:28.356286 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 14/34] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:27 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1222 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:28.642799 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1447189111", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:28.776722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] validate_networks() for [('9823c1ef-0097-4726-b18e-20812226ba01', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:37:28.966349 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f1f67819-d255-4924-a6fa-5535eb653c59 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:28.966972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f1f67819-d255-4924-a6fa-5535eb653c59 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:29.200422 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f1f67819-d255-4924-a6fa-5535eb653c59 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:29.212116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f1f67819-d255-4924-a6fa-5535eb653c59 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1214 microversion: 2.1 time: 0.254105 Aug 01 07:37:29.219185 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 15/35] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:28 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1214 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:29.361391 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f5cb892e-65e8-480b-b99c-8e9e6ab787f6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:29.362155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f5cb892e-65e8-480b-b99c-8e9e6ab787f6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:29.601532 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f5cb892e-65e8-480b-b99c-8e9e6ab787f6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:29.612833 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f5cb892e-65e8-480b-b99c-8e9e6ab787f6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1238 microversion: 2.1 time: 0.256140 Aug 01 07:37:29.628272 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 16/36] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:29 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1238 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:30.241578 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0774692b-5b6f-4753-944b-d090fe38dc1b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:30.243433 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0774692b-5b6f-4753-944b-d090fe38dc1b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:30.555322 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0774692b-5b6f-4753-944b-d090fe38dc1b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:30.567880 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0774692b-5b6f-4753-944b-d090fe38dc1b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1214 microversion: 2.1 time: 0.329509 Aug 01 07:37:30.570100 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 17/37] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:30 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:30.626922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:37:30.627641 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:37:30.628341 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:37:30.628967 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:37:30.629668 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:37:30.639305 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7f25ada7-1ecb-4c22-b310-3330bf182855 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:30.640266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7f25ada7-1ecb-4c22-b310-3330bf182855 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:30.653038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f25ada7-1ecb-4c22-b310-3330bf182855 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:30.657441 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f25ada7-1ecb-4c22-b310-3330bf182855 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:30.659458 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f25ada7-1ecb-4c22-b310-3330bf182855 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:30.663370 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f25ada7-1ecb-4c22-b310-3330bf182855 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:30.670880 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:30.674287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:30.675453 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:30.676192 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:30.741830 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Getting quotas for project 015cc91d3e2f4d3791301c05e4c8be20. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:37:30.754116 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Getting quotas for user db6ac4cf9dd84e338f944b4905dcdb50 and project 015cc91d3e2f4d3791301c05e4c8be20. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:37:30.783172 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:37:30.792692 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:37:30.923373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6adddbbb-ff4a-4969-bb00-2cf63e483237 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.284806 Aug 01 07:37:30.929811 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 21/38] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:37:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:37:30.936093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a28d52fb-424f-495c-bc0f-94199efcd142 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:30.936835 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a28d52fb-424f-495c-bc0f-94199efcd142 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:31.125286 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7f25ada7-1ecb-4c22-b310-3330bf182855 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:31.141134 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7f25ada7-1ecb-4c22-b310-3330bf182855 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1242 microversion: 2.1 time: 0.507321 Aug 01 07:37:31.142097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 18/39] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:30 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1242 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:31.160427 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a28d52fb-424f-495c-bc0f-94199efcd142 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:31.170702 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a28d52fb-424f-495c-bc0f-94199efcd142 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1222 microversion: 2.1 time: 0.238678 Aug 01 07:37:31.173939 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 22/40] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:30 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1222 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:31.594356 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-14a3d4ee-b8fb-4d37-9ced-d910f6e7235e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:31.595244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-14a3d4ee-b8fb-4d37-9ced-d910f6e7235e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:31.606898 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-14a3d4ee-b8fb-4d37-9ced-d910f6e7235e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:31.609987 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-14a3d4ee-b8fb-4d37-9ced-d910f6e7235e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:31.611002 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-14a3d4ee-b8fb-4d37-9ced-d910f6e7235e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:31.615132 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-14a3d4ee-b8fb-4d37-9ced-d910f6e7235e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:31.741254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-14a3d4ee-b8fb-4d37-9ced-d910f6e7235e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:31.752553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-14a3d4ee-b8fb-4d37-9ced-d910f6e7235e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1218 microversion: 2.1 time: 0.164880 Aug 01 07:37:31.753764 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 19/41] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:31 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:32.162936 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-34974316-6756-4f2c-a926-3b099a4396e7 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:32.163852 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-34974316-6756-4f2c-a926-3b099a4396e7 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:32.182147 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34974316-6756-4f2c-a926-3b099a4396e7 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:32.182600 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34974316-6756-4f2c-a926-3b099a4396e7 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:32.183426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34974316-6756-4f2c-a926-3b099a4396e7 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:32.183871 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34974316-6756-4f2c-a926-3b099a4396e7 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:32.196274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c3f71993-9467-4db7-8674-c7d6d1adf8be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:32.196891 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c3f71993-9467-4db7-8674-c7d6d1adf8be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:32.214442 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c3f71993-9467-4db7-8674-c7d6d1adf8be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:32.216472 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c3f71993-9467-4db7-8674-c7d6d1adf8be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:32.223359 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c3f71993-9467-4db7-8674-c7d6d1adf8be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:32.223833 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c3f71993-9467-4db7-8674-c7d6d1adf8be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:32.396752 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c3f71993-9467-4db7-8674-c7d6d1adf8be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:32.408869 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c3f71993-9467-4db7-8674-c7d6d1adf8be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1226 microversion: 2.1 time: 0.218066 Aug 01 07:37:32.420252 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 20/42] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:32 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1226 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:32.512885 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-34974316-6756-4f2c-a926-3b099a4396e7 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:32.541111 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-34974316-6756-4f2c-a926-3b099a4396e7 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1242 microversion: 2.1 time: 0.377414 Aug 01 07:37:32.541777 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 23/43] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:32 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1242 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:32.777946 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7ee7db18-4070-4283-a9dc-6882ba2d1097 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:32.779181 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7ee7db18-4070-4283-a9dc-6882ba2d1097 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:32.791830 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7ee7db18-4070-4283-a9dc-6882ba2d1097 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:32.792631 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7ee7db18-4070-4283-a9dc-6882ba2d1097 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:32.793617 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7ee7db18-4070-4283-a9dc-6882ba2d1097 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:32.794251 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7ee7db18-4070-4283-a9dc-6882ba2d1097 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:32.902327 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7ee7db18-4070-4283-a9dc-6882ba2d1097 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:32.937128 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7ee7db18-4070-4283-a9dc-6882ba2d1097 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1218 microversion: 2.1 time: 0.166511 Aug 01 07:37:32.938154 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 21/44] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:32 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:33.068355 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1490726021", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0dc32e8a-ab07-41b5-814a-a9a38a1db465"}], "security_groups": [{"name": "tempest-securitygroup--240602568"}], "key_name": "tempest-keypair-1027807052", "user_data": "}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:33.279267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] validate_networks() for [('0dc32e8a-ab07-41b5-814a-a9a38a1db465', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:37:33.438747 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2fe30eb9-2e0d-496f-8bf4-b40b62585c85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:33.439393 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2fe30eb9-2e0d-496f-8bf4-b40b62585c85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:33.450703 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2fe30eb9-2e0d-496f-8bf4-b40b62585c85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:33.451204 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2fe30eb9-2e0d-496f-8bf4-b40b62585c85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:33.452001 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2fe30eb9-2e0d-496f-8bf4-b40b62585c85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:33.452448 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2fe30eb9-2e0d-496f-8bf4-b40b62585c85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:33.576097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2fe30eb9-2e0d-496f-8bf4-b40b62585c85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:33.586086 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2fe30eb9-2e0d-496f-8bf4-b40b62585c85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1218 microversion: 2.1 time: 0.151210 Aug 01 07:37:33.586984 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 22/45] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:33 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:33.592899 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-af263601-14cc-46e9-a37d-6106edadfd51 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:33.594846 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-af263601-14cc-46e9-a37d-6106edadfd51 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:33.603580 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af263601-14cc-46e9-a37d-6106edadfd51 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:33.604050 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af263601-14cc-46e9-a37d-6106edadfd51 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:33.604956 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af263601-14cc-46e9-a37d-6106edadfd51 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:33.605418 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af263601-14cc-46e9-a37d-6106edadfd51 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:33.679011 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-af263601-14cc-46e9-a37d-6106edadfd51 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:33.693588 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-af263601-14cc-46e9-a37d-6106edadfd51 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1234 microversion: 2.1 time: 0.105251 Aug 01 07:37:33.708440 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 23/46] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:33 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1234 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:33.961594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d0275e70-1157-40a7-a489-752ac385bce0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:33.963053 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d0275e70-1157-40a7-a489-752ac385bce0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:33.976704 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d0275e70-1157-40a7-a489-752ac385bce0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:33.981697 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d0275e70-1157-40a7-a489-752ac385bce0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:33.983187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d0275e70-1157-40a7-a489-752ac385bce0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:33.984041 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d0275e70-1157-40a7-a489-752ac385bce0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:34.143750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d0275e70-1157-40a7-a489-752ac385bce0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:34.163435 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d0275e70-1157-40a7-a489-752ac385bce0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1274 microversion: 2.1 time: 0.197536 Aug 01 07:37:34.164756 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 24/47] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:33 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:34.239234 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:37:34.240529 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:37:34.241224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:37:34.241963 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:37:34.242572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:37:34.257215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:34.257905 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:34.258936 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:34.259611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:34.314404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Getting quotas for project 4a2b83a4dad243e79144db87357d1897. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:37:34.326665 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Getting quotas for user 1e02f414ef2a4990bd1492a63d074319 and project 4a2b83a4dad243e79144db87357d1897. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:37:34.381295 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:37:34.389620 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:37:34.567001 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0a68a040-684d-48ca-aeb3-01c0874fa062 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.502942 Aug 01 07:37:34.568136 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 24/48] 10.222.0.40 () {62 vars in 1188 bytes} [Mon Aug 1 07:37:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 01 07:37:34.579328 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1c89c727-8aaa-4b83-aa3d-6ae489d63188 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:34.579903 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1c89c727-8aaa-4b83-aa3d-6ae489d63188 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:34.618663 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e07ff39a-4c5c-4e5d-8887-38dd20c8236d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:34.619643 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e07ff39a-4c5c-4e5d-8887-38dd20c8236d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:34.653216 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e07ff39a-4c5c-4e5d-8887-38dd20c8236d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:34.654164 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e07ff39a-4c5c-4e5d-8887-38dd20c8236d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:34.658250 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e07ff39a-4c5c-4e5d-8887-38dd20c8236d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:34.658713 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e07ff39a-4c5c-4e5d-8887-38dd20c8236d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:34.844247 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e07ff39a-4c5c-4e5d-8887-38dd20c8236d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:34.857314 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e07ff39a-4c5c-4e5d-8887-38dd20c8236d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1274 microversion: 2.1 time: 0.243319 Aug 01 07:37:34.865580 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 25/49] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:34 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:34.878002 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5eb625dd-bab1-472c-bb7f-2bdd392f3f48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:34.879643 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5eb625dd-bab1-472c-bb7f-2bdd392f3f48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:34.899562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5eb625dd-bab1-472c-bb7f-2bdd392f3f48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:34.901586 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5eb625dd-bab1-472c-bb7f-2bdd392f3f48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:34.904832 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5eb625dd-bab1-472c-bb7f-2bdd392f3f48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:34.905544 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5eb625dd-bab1-472c-bb7f-2bdd392f3f48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:35.290000 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5eb625dd-bab1-472c-bb7f-2bdd392f3f48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:35.305378 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5eb625dd-bab1-472c-bb7f-2bdd392f3f48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1290 microversion: 2.1 time: 0.436545 Aug 01 07:37:35.321147 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 26/50] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:34 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1290 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:35.344436 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1c89c727-8aaa-4b83-aa3d-6ae489d63188 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:35.353130 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1c89c727-8aaa-4b83-aa3d-6ae489d63188 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:35.354745 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1c89c727-8aaa-4b83-aa3d-6ae489d63188 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:35.366614 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1c89c727-8aaa-4b83-aa3d-6ae489d63188 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1282 microversion: 2.20 time: 0.791407 Aug 01 07:37:35.369710 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:34 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1282 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:35.381423 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d8ee30d3-6343-4ecc-b48c-12af8e36c1c1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:35.384716 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d8ee30d3-6343-4ecc-b48c-12af8e36c1c1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:35.447761 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d8ee30d3-6343-4ecc-b48c-12af8e36c1c1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:35.448234 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d8ee30d3-6343-4ecc-b48c-12af8e36c1c1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:35.449044 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d8ee30d3-6343-4ecc-b48c-12af8e36c1c1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:35.449500 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d8ee30d3-6343-4ecc-b48c-12af8e36c1c1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:35.888741 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d14b8508-6582-455b-9ef1-350d7cd1df7d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:35.889366 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d14b8508-6582-455b-9ef1-350d7cd1df7d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:35.909505 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d14b8508-6582-455b-9ef1-350d7cd1df7d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:35.910083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d14b8508-6582-455b-9ef1-350d7cd1df7d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:35.917662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d14b8508-6582-455b-9ef1-350d7cd1df7d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:35.918220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d14b8508-6582-455b-9ef1-350d7cd1df7d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:36.284286 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d8ee30d3-6343-4ecc-b48c-12af8e36c1c1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:36.315477 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d8ee30d3-6343-4ecc-b48c-12af8e36c1c1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1284 microversion: 2.1 time: 0.977060 Aug 01 07:37:36.318921 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 27/52] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:35 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1284 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:36.335563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-86a43d78-e917-43b3-aeb9-cfc5052a0c68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:36.356094 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-86a43d78-e917-43b3-aeb9-cfc5052a0c68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:36.390784 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-86a43d78-e917-43b3-aeb9-cfc5052a0c68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:36.394007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-86a43d78-e917-43b3-aeb9-cfc5052a0c68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:36.398576 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-86a43d78-e917-43b3-aeb9-cfc5052a0c68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:36.401373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-86a43d78-e917-43b3-aeb9-cfc5052a0c68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:36.498170 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d14b8508-6582-455b-9ef1-350d7cd1df7d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:36.509819 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d14b8508-6582-455b-9ef1-350d7cd1df7d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1292 microversion: 2.1 time: 0.623856 Aug 01 07:37:36.523100 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 26/53] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:35 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1292 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:36.523100 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:36.529049 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3aed1e46-075d-439e-bf4e-0a8441e3b6f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:36.532166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3aed1e46-075d-439e-bf4e-0a8441e3b6f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:36.560092 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3aed1e46-075d-439e-bf4e-0a8441e3b6f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:36.560560 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3aed1e46-075d-439e-bf4e-0a8441e3b6f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:36.561345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3aed1e46-075d-439e-bf4e-0a8441e3b6f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:36.561787 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3aed1e46-075d-439e-bf4e-0a8441e3b6f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:36.968241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-86a43d78-e917-43b3-aeb9-cfc5052a0c68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:36.980672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-86a43d78-e917-43b3-aeb9-cfc5052a0c68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.653808 Aug 01 07:37:36.981357 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 28/54] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:36 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:37.009014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3aed1e46-075d-439e-bf4e-0a8441e3b6f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:37.024033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3aed1e46-075d-439e-bf4e-0a8441e3b6f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:37.027260 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3aed1e46-075d-439e-bf4e-0a8441e3b6f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:37.028610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3aed1e46-075d-439e-bf4e-0a8441e3b6f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1334 microversion: 2.20 time: 0.513991 Aug 01 07:37:37.029551 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 27/55] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:36 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1334 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:37.341606 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f3d47d70-4f5f-41d7-88c8-33060a3b08c4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:37.345145 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f3d47d70-4f5f-41d7-88c8-33060a3b08c4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:37.358366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:37.366610 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f3d47d70-4f5f-41d7-88c8-33060a3b08c4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:37.367412 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f3d47d70-4f5f-41d7-88c8-33060a3b08c4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:37.368703 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f3d47d70-4f5f-41d7-88c8-33060a3b08c4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:37.370347 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f3d47d70-4f5f-41d7-88c8-33060a3b08c4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:37.539311 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5c801461-177e-4099-99be-48b8337020c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:37.539927 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5c801461-177e-4099-99be-48b8337020c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:37.551631 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5c801461-177e-4099-99be-48b8337020c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:37.553006 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5c801461-177e-4099-99be-48b8337020c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:37.554639 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5c801461-177e-4099-99be-48b8337020c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:37.555161 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5c801461-177e-4099-99be-48b8337020c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:37.657562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5c801461-177e-4099-99be-48b8337020c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:37.666735 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5c801461-177e-4099-99be-48b8337020c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.131318 Aug 01 07:37:37.673086 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 28/56] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:37 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:37.923872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f3d47d70-4f5f-41d7-88c8-33060a3b08c4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:37.932830 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f3d47d70-4f5f-41d7-88c8-33060a3b08c4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.594938 Aug 01 07:37:37.934046 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 29/57] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:37 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:38.001840 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6546877f-04a2-4c22-a76d-3ff663279887 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:38.002472 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6546877f-04a2-4c22-a76d-3ff663279887 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:38.017069 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6546877f-04a2-4c22-a76d-3ff663279887 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:38.017535 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6546877f-04a2-4c22-a76d-3ff663279887 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:38.018325 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6546877f-04a2-4c22-a76d-3ff663279887 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:38.023549 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6546877f-04a2-4c22-a76d-3ff663279887 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:38.060022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5bab1a3d-f6c3-4bc3-86b0-26bf8e3d8de8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:38.060637 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5bab1a3d-f6c3-4bc3-86b0-26bf8e3d8de8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:38.067441 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5bab1a3d-f6c3-4bc3-86b0-26bf8e3d8de8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:38.069759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5bab1a3d-f6c3-4bc3-86b0-26bf8e3d8de8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:38.075420 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5bab1a3d-f6c3-4bc3-86b0-26bf8e3d8de8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:38.076081 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5bab1a3d-f6c3-4bc3-86b0-26bf8e3d8de8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:38.182278 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6546877f-04a2-4c22-a76d-3ff663279887 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:38.194137 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5bab1a3d-f6c3-4bc3-86b0-26bf8e3d8de8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:38.195274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6546877f-04a2-4c22-a76d-3ff663279887 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.197238 Aug 01 07:37:38.208156 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 29/58] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:37 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:38.219752 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5bab1a3d-f6c3-4bc3-86b0-26bf8e3d8de8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:38.222713 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5bab1a3d-f6c3-4bc3-86b0-26bf8e3d8de8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:38.225115 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5bab1a3d-f6c3-4bc3-86b0-26bf8e3d8de8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1334 microversion: 2.20 time: 0.174629 Aug 01 07:37:38.226608 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 30/59] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:38 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1334 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:37:38.695391 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-face8eef-c029-4fe2-86a8-40eeaecef8a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:38.696208 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-face8eef-c029-4fe2-86a8-40eeaecef8a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:38.712522 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-face8eef-c029-4fe2-86a8-40eeaecef8a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:38.713603 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-face8eef-c029-4fe2-86a8-40eeaecef8a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:38.715404 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-face8eef-c029-4fe2-86a8-40eeaecef8a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:38.720217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-face8eef-c029-4fe2-86a8-40eeaecef8a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:38.805028 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-face8eef-c029-4fe2-86a8-40eeaecef8a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:38.812501 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-face8eef-c029-4fe2-86a8-40eeaecef8a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.122151 Aug 01 07:37:38.813093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 30/60] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:38 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:38.955884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-41b1f0e0-88f7-47fd-bf56-b7212490cc7b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:38.956676 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-41b1f0e0-88f7-47fd-bf56-b7212490cc7b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:38.964157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41b1f0e0-88f7-47fd-bf56-b7212490cc7b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:38.964157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41b1f0e0-88f7-47fd-bf56-b7212490cc7b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:38.964918 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41b1f0e0-88f7-47fd-bf56-b7212490cc7b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:38.965353 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41b1f0e0-88f7-47fd-bf56-b7212490cc7b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:39.132395 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-41b1f0e0-88f7-47fd-bf56-b7212490cc7b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:39.141942 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-41b1f0e0-88f7-47fd-bf56-b7212490cc7b tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.189701 Aug 01 07:37:39.142977 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 31/61] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:38 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:39.225203 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-922a351a-069d-44cc-a80d-525c4ccc726d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:39.226397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-922a351a-069d-44cc-a80d-525c4ccc726d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:39.235611 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-922a351a-069d-44cc-a80d-525c4ccc726d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:39.236411 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-922a351a-069d-44cc-a80d-525c4ccc726d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:39.237484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-922a351a-069d-44cc-a80d-525c4ccc726d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:39.238134 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-922a351a-069d-44cc-a80d-525c4ccc726d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:39.253419 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-906cf0e0-7642-448b-9ca9-a18c4ce8026d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:39.254173 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-906cf0e0-7642-448b-9ca9-a18c4ce8026d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:39.267022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-906cf0e0-7642-448b-9ca9-a18c4ce8026d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:39.268011 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-906cf0e0-7642-448b-9ca9-a18c4ce8026d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:39.269754 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-906cf0e0-7642-448b-9ca9-a18c4ce8026d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:39.270411 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-906cf0e0-7642-448b-9ca9-a18c4ce8026d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:39.346562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-922a351a-069d-44cc-a80d-525c4ccc726d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:39.367385 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-922a351a-069d-44cc-a80d-525c4ccc726d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.154612 Aug 01 07:37:39.370543 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 31/62] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:39 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:39.445112 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-906cf0e0-7642-448b-9ca9-a18c4ce8026d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:39.453128 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-906cf0e0-7642-448b-9ca9-a18c4ce8026d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:39.454656 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-906cf0e0-7642-448b-9ca9-a18c4ce8026d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:39.455806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-906cf0e0-7642-448b-9ca9-a18c4ce8026d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1334 microversion: 2.20 time: 0.207071 Aug 01 07:37:39.456410 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 32/63] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:39 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1334 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:37:39.839005 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-34e81ffe-ed8c-4ae6-9986-fd6a5d6fca31 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:39.840528 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-34e81ffe-ed8c-4ae6-9986-fd6a5d6fca31 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:39.858611 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-34e81ffe-ed8c-4ae6-9986-fd6a5d6fca31 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:39.859959 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-34e81ffe-ed8c-4ae6-9986-fd6a5d6fca31 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:39.861571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-34e81ffe-ed8c-4ae6-9986-fd6a5d6fca31 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:39.862686 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-34e81ffe-ed8c-4ae6-9986-fd6a5d6fca31 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:39.975026 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-34e81ffe-ed8c-4ae6-9986-fd6a5d6fca31 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:39.982744 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-34e81ffe-ed8c-4ae6-9986-fd6a5d6fca31 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.152141 Aug 01 07:37:39.983355 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 32/64] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:39 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:40.165876 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4ceebde2-2687-41af-9047-6a331f37ba92 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:40.166500 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4ceebde2-2687-41af-9047-6a331f37ba92 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:40.179465 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4ceebde2-2687-41af-9047-6a331f37ba92 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:40.179936 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4ceebde2-2687-41af-9047-6a331f37ba92 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:40.181247 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4ceebde2-2687-41af-9047-6a331f37ba92 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:40.187732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4ceebde2-2687-41af-9047-6a331f37ba92 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:40.393239 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2e2cbd71-e883-4e72-b7a4-be66bb06bd10 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:40.393855 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2e2cbd71-e883-4e72-b7a4-be66bb06bd10 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:40.409267 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e2cbd71-e883-4e72-b7a4-be66bb06bd10 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:40.410058 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e2cbd71-e883-4e72-b7a4-be66bb06bd10 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:40.411188 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e2cbd71-e883-4e72-b7a4-be66bb06bd10 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:40.412394 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e2cbd71-e883-4e72-b7a4-be66bb06bd10 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:40.497618 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4ceebde2-2687-41af-9047-6a331f37ba92 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:40.506013 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4ceebde2-2687-41af-9047-6a331f37ba92 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.344356 Aug 01 07:37:40.515750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 33/65] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:40 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:40.515750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b751a742-31a3-4474-bd00-116ec9558616 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:40.515750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b751a742-31a3-4474-bd00-116ec9558616 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:40.525388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b751a742-31a3-4474-bd00-116ec9558616 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:40.525848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b751a742-31a3-4474-bd00-116ec9558616 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:40.529577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b751a742-31a3-4474-bd00-116ec9558616 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:40.530178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b751a742-31a3-4474-bd00-116ec9558616 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:40.611748 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2e2cbd71-e883-4e72-b7a4-be66bb06bd10 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:40.622802 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2e2cbd71-e883-4e72-b7a4-be66bb06bd10 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.231547 Aug 01 07:37:40.637603 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 33/66] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:40 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:40.664120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b751a742-31a3-4474-bd00-116ec9558616 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:40.686085 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b751a742-31a3-4474-bd00-116ec9558616 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:40.687658 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b751a742-31a3-4474-bd00-116ec9558616 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:40.688771 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b751a742-31a3-4474-bd00-116ec9558616 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1334 microversion: 2.20 time: 0.179986 Aug 01 07:37:40.689331 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 34/67] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:40 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1334 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:41.013889 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-68826c7a-699d-4f68-83ca-1e24420e3156 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:41.016090 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-68826c7a-699d-4f68-83ca-1e24420e3156 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:41.024699 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68826c7a-699d-4f68-83ca-1e24420e3156 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:41.025731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68826c7a-699d-4f68-83ca-1e24420e3156 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:41.026681 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68826c7a-699d-4f68-83ca-1e24420e3156 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:41.027349 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68826c7a-699d-4f68-83ca-1e24420e3156 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:41.101918 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-68826c7a-699d-4f68-83ca-1e24420e3156 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:41.111523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-68826c7a-699d-4f68-83ca-1e24420e3156 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.109626 Aug 01 07:37:41.119647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 34/68] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:40 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:41.531156 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-483685fc-af63-4a02-8187-ccfaa3210b90 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:41.532375 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-483685fc-af63-4a02-8187-ccfaa3210b90 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:41.539689 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-483685fc-af63-4a02-8187-ccfaa3210b90 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:41.540391 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-483685fc-af63-4a02-8187-ccfaa3210b90 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:41.541362 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-483685fc-af63-4a02-8187-ccfaa3210b90 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:41.541983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-483685fc-af63-4a02-8187-ccfaa3210b90 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:41.648649 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-385ae539-3c92-416d-b99f-cc7c71f07974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:41.651517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-385ae539-3c92-416d-b99f-cc7c71f07974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:41.660788 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-385ae539-3c92-416d-b99f-cc7c71f07974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:41.662671 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-385ae539-3c92-416d-b99f-cc7c71f07974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:41.664322 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-385ae539-3c92-416d-b99f-cc7c71f07974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:41.664402 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-385ae539-3c92-416d-b99f-cc7c71f07974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:41.669030 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=100 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:41.734616 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-483685fc-af63-4a02-8187-ccfaa3210b90 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:41.742232 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-483685fc-af63-4a02-8187-ccfaa3210b90 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.214953 Aug 01 07:37:41.742807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 35/69] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:41 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:41.747500 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f0283043-0664-4eb3-ab3d-e73e3dc0b047 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:41.748293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f0283043-0664-4eb3-ab3d-e73e3dc0b047 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:41.754946 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f0283043-0664-4eb3-ab3d-e73e3dc0b047 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:41.755829 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f0283043-0664-4eb3-ab3d-e73e3dc0b047 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:41.756708 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f0283043-0664-4eb3-ab3d-e73e3dc0b047 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:41.757175 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f0283043-0664-4eb3-ab3d-e73e3dc0b047 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:41.757862 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-385ae539-3c92-416d-b99f-cc7c71f07974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:41.785069 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-385ae539-3c92-416d-b99f-cc7c71f07974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.142761 Aug 01 07:37:41.786249 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 35/70] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:41 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:41.883515 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f0283043-0664-4eb3-ab3d-e73e3dc0b047 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:41.892221 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f0283043-0664-4eb3-ab3d-e73e3dc0b047 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:41.894566 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f0283043-0664-4eb3-ab3d-e73e3dc0b047 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:41.896065 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f0283043-0664-4eb3-ab3d-e73e3dc0b047 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1334 microversion: 2.20 time: 0.152024 Aug 01 07:37:41.896866 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 36/71] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:41 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1334 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:42.135271 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a0bf870b-104d-4924-b6b7-50d9f15a09dd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:42.135960 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a0bf870b-104d-4924-b6b7-50d9f15a09dd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:42.143961 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a0bf870b-104d-4924-b6b7-50d9f15a09dd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:42.144925 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a0bf870b-104d-4924-b6b7-50d9f15a09dd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:42.145958 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a0bf870b-104d-4924-b6b7-50d9f15a09dd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:42.147313 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a0bf870b-104d-4924-b6b7-50d9f15a09dd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:42.265853 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a0bf870b-104d-4924-b6b7-50d9f15a09dd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:42.280202 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a0bf870b-104d-4924-b6b7-50d9f15a09dd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.149880 Aug 01 07:37:42.281204 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 36/72] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:42 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:42.773030 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-af76fdf2-6cd2-4a58-8a45-5147bc8a2957 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:42.773030 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-af76fdf2-6cd2-4a58-8a45-5147bc8a2957 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:42.778716 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-af76fdf2-6cd2-4a58-8a45-5147bc8a2957 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:42.779301 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-af76fdf2-6cd2-4a58-8a45-5147bc8a2957 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:42.780226 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-af76fdf2-6cd2-4a58-8a45-5147bc8a2957 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:42.780600 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-af76fdf2-6cd2-4a58-8a45-5147bc8a2957 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:42.808856 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5ff45da1-84ec-46cd-a121-25f79d65f5c9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:42.809578 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5ff45da1-84ec-46cd-a121-25f79d65f5c9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:42.819361 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ff45da1-84ec-46cd-a121-25f79d65f5c9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:42.819832 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ff45da1-84ec-46cd-a121-25f79d65f5c9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:42.821034 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ff45da1-84ec-46cd-a121-25f79d65f5c9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:42.821487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ff45da1-84ec-46cd-a121-25f79d65f5c9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:42.926881 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5ff45da1-84ec-46cd-a121-25f79d65f5c9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:42.935979 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5ff45da1-84ec-46cd-a121-25f79d65f5c9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.131652 Aug 01 07:37:42.936910 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 37/73] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:42 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:42.943858 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d7b21c3a-dbe9-47b5-93d4-8142483c994d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:42.944744 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d7b21c3a-dbe9-47b5-93d4-8142483c994d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:42.958077 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d7b21c3a-dbe9-47b5-93d4-8142483c994d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:42.959559 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d7b21c3a-dbe9-47b5-93d4-8142483c994d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:42.960751 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d7b21c3a-dbe9-47b5-93d4-8142483c994d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:42.961335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d7b21c3a-dbe9-47b5-93d4-8142483c994d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:43.037702 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d7b21c3a-dbe9-47b5-93d4-8142483c994d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:43.046618 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d7b21c3a-dbe9-47b5-93d4-8142483c994d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:43.048590 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d7b21c3a-dbe9-47b5-93d4-8142483c994d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:43.050210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d7b21c3a-dbe9-47b5-93d4-8142483c994d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1334 microversion: 2.20 time: 0.112027 Aug 01 07:37:43.051001 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:42 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:43.057010 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-af76fdf2-6cd2-4a58-8a45-5147bc8a2957 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:43.066573 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-af76fdf2-6cd2-4a58-8a45-5147bc8a2957 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.301235 Aug 01 07:37:43.067960 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 37/75] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:42 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:43.304489 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7608a958-d8a5-447d-a4a4-75cae4215792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:43.305692 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7608a958-d8a5-447d-a4a4-75cae4215792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:43.322774 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7608a958-d8a5-447d-a4a4-75cae4215792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:43.323534 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7608a958-d8a5-447d-a4a4-75cae4215792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:43.324302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7608a958-d8a5-447d-a4a4-75cae4215792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:43.324748 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7608a958-d8a5-447d-a4a4-75cae4215792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:43.417462 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7608a958-d8a5-447d-a4a4-75cae4215792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:43.434916 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7608a958-d8a5-447d-a4a4-75cae4215792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.134661 Aug 01 07:37:43.435709 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 39/76] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:43 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:43.957798 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c8e17506-d89c-4001-af8b-7ed3e0210ccc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:43.959100 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c8e17506-d89c-4001-af8b-7ed3e0210ccc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:43.970922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c8e17506-d89c-4001-af8b-7ed3e0210ccc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:43.971424 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c8e17506-d89c-4001-af8b-7ed3e0210ccc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:43.972209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c8e17506-d89c-4001-af8b-7ed3e0210ccc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:43.972649 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c8e17506-d89c-4001-af8b-7ed3e0210ccc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:44.054126 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c8e17506-d89c-4001-af8b-7ed3e0210ccc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:44.063007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c8e17506-d89c-4001-af8b-7ed3e0210ccc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.109006 Aug 01 07:37:44.063751 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 38/77] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:43 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:44.075275 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-88b4d22d-ba68-4d74-a4eb-55eb9662c244 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:44.075971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-88b4d22d-ba68-4d74-a4eb-55eb9662c244 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:44.083214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-88b4d22d-ba68-4d74-a4eb-55eb9662c244 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:44.083214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-88b4d22d-ba68-4d74-a4eb-55eb9662c244 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:44.083765 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-88b4d22d-ba68-4d74-a4eb-55eb9662c244 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:44.084216 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-88b4d22d-ba68-4d74-a4eb-55eb9662c244 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:44.089608 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0f24604b-19c0-4303-9c09-1567d0d7f4f9 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:44.089608 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0f24604b-19c0-4303-9c09-1567d0d7f4f9 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:44.095792 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0f24604b-19c0-4303-9c09-1567d0d7f4f9 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:44.096251 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0f24604b-19c0-4303-9c09-1567d0d7f4f9 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:44.097025 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0f24604b-19c0-4303-9c09-1567d0d7f4f9 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:44.097467 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0f24604b-19c0-4303-9c09-1567d0d7f4f9 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:44.102086 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:44.175344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-88b4d22d-ba68-4d74-a4eb-55eb9662c244 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:44.183986 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-88b4d22d-ba68-4d74-a4eb-55eb9662c244 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:44.185518 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-88b4d22d-ba68-4d74-a4eb-55eb9662c244 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:44.186640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-88b4d22d-ba68-4d74-a4eb-55eb9662c244 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1334 microversion: 2.20 time: 0.115284 Aug 01 07:37:44.187415 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 40/78] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:44 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1334 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:44.271460 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=8 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:44.275706 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0f24604b-19c0-4303-9c09-1567d0d7f4f9 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:44.283714 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0f24604b-19c0-4303-9c09-1567d0d7f4f9 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.198774 Aug 01 07:37:44.284364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 39/79] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:44 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:44.455705 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e5c9b10c-b0e8-4e5c-9f15-9170f00a9790 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:44.457240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e5c9b10c-b0e8-4e5c-9f15-9170f00a9790 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:44.465170 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e5c9b10c-b0e8-4e5c-9f15-9170f00a9790 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:44.465632 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e5c9b10c-b0e8-4e5c-9f15-9170f00a9790 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:44.466404 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e5c9b10c-b0e8-4e5c-9f15-9170f00a9790 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:44.466861 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e5c9b10c-b0e8-4e5c-9f15-9170f00a9790 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:44.536718 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e5c9b10c-b0e8-4e5c-9f15-9170f00a9790 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:44.546947 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e5c9b10c-b0e8-4e5c-9f15-9170f00a9790 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.095152 Aug 01 07:37:44.548192 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 41/80] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:44 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:45.086055 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-143cba6a-70ed-41fc-8194-6ff60cf5328b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:45.086609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-143cba6a-70ed-41fc-8194-6ff60cf5328b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:45.088913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=32 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:45.102292 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-143cba6a-70ed-41fc-8194-6ff60cf5328b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:45.103828 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-143cba6a-70ed-41fc-8194-6ff60cf5328b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:45.104982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-143cba6a-70ed-41fc-8194-6ff60cf5328b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:45.105721 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-143cba6a-70ed-41fc-8194-6ff60cf5328b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:45.168120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-143cba6a-70ed-41fc-8194-6ff60cf5328b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:45.176455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-143cba6a-70ed-41fc-8194-6ff60cf5328b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.094851 Aug 01 07:37:45.183332 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 40/81] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:45 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:45.210377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1d3128f7-663d-4ac3-8a26-51c46f4f1e97 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:45.210976 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1d3128f7-663d-4ac3-8a26-51c46f4f1e97 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:45.213926 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:45.218527 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d3128f7-663d-4ac3-8a26-51c46f4f1e97 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:45.218974 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d3128f7-663d-4ac3-8a26-51c46f4f1e97 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:45.219752 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d3128f7-663d-4ac3-8a26-51c46f4f1e97 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:45.220178 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d3128f7-663d-4ac3-8a26-51c46f4f1e97 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:45.288716 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1d3128f7-663d-4ac3-8a26-51c46f4f1e97 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:45.297004 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1d3128f7-663d-4ac3-8a26-51c46f4f1e97 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:45.298556 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1d3128f7-663d-4ac3-8a26-51c46f4f1e97 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:45.299675 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1d3128f7-663d-4ac3-8a26-51c46f4f1e97 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1334 microversion: 2.20 time: 0.093983 Aug 01 07:37:45.300217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 42/82] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:45 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:45.308092 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-55fb7715-00be-4241-8e20-4c10a06b2194 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:45.309009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-55fb7715-00be-4241-8e20-4c10a06b2194 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:45.315267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-55fb7715-00be-4241-8e20-4c10a06b2194 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:45.315713 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-55fb7715-00be-4241-8e20-4c10a06b2194 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:45.316471 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-55fb7715-00be-4241-8e20-4c10a06b2194 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:45.316906 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-55fb7715-00be-4241-8e20-4c10a06b2194 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:45.456545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-55fb7715-00be-4241-8e20-4c10a06b2194 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:45.464348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-55fb7715-00be-4241-8e20-4c10a06b2194 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.160121 Aug 01 07:37:45.464906 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 41/83] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:45 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:45.568919 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c62e1565-e809-4235-b7b9-0d7e95049c0c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:45.570085 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c62e1565-e809-4235-b7b9-0d7e95049c0c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:45.575662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=22 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:45.578025 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c62e1565-e809-4235-b7b9-0d7e95049c0c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:45.578780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c62e1565-e809-4235-b7b9-0d7e95049c0c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:45.579972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c62e1565-e809-4235-b7b9-0d7e95049c0c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:45.580612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c62e1565-e809-4235-b7b9-0d7e95049c0c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:45.648354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c62e1565-e809-4235-b7b9-0d7e95049c0c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:45.656403 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c62e1565-e809-4235-b7b9-0d7e95049c0c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.092078 Aug 01 07:37:45.656945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 43/84] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:45 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:46.199160 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0b82142e-0b24-4af4-b864-68ce55ffb844 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:46.199769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0b82142e-0b24-4af4-b864-68ce55ffb844 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:46.205837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0b82142e-0b24-4af4-b864-68ce55ffb844 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:46.206318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0b82142e-0b24-4af4-b864-68ce55ffb844 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:46.207091 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0b82142e-0b24-4af4-b864-68ce55ffb844 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:46.207593 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0b82142e-0b24-4af4-b864-68ce55ffb844 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:46.272424 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0b82142e-0b24-4af4-b864-68ce55ffb844 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:46.279888 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0b82142e-0b24-4af4-b864-68ce55ffb844 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.084692 Aug 01 07:37:46.280442 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 42/85] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:46 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:46.322704 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6aa2d8e1-b870-4628-9c91-d4d4dd34cad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:46.323351 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6aa2d8e1-b870-4628-9c91-d4d4dd34cad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:46.329345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6aa2d8e1-b870-4628-9c91-d4d4dd34cad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:46.331633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6aa2d8e1-b870-4628-9c91-d4d4dd34cad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:46.332443 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6aa2d8e1-b870-4628-9c91-d4d4dd34cad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:46.332922 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6aa2d8e1-b870-4628-9c91-d4d4dd34cad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:46.405518 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6aa2d8e1-b870-4628-9c91-d4d4dd34cad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:46.414262 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6aa2d8e1-b870-4628-9c91-d4d4dd34cad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:46.416118 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6aa2d8e1-b870-4628-9c91-d4d4dd34cad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:46.417231 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6aa2d8e1-b870-4628-9c91-d4d4dd34cad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1334 microversion: 2.20 time: 0.098735 Aug 01 07:37:46.417782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 44/86] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:46 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:46.485774 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-44f59870-6f52-4a82-8310-8fed0752767f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:46.486678 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-44f59870-6f52-4a82-8310-8fed0752767f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:46.493919 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-44f59870-6f52-4a82-8310-8fed0752767f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:46.494814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-44f59870-6f52-4a82-8310-8fed0752767f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:46.495760 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-44f59870-6f52-4a82-8310-8fed0752767f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:46.496226 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-44f59870-6f52-4a82-8310-8fed0752767f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:46.653947 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-44f59870-6f52-4a82-8310-8fed0752767f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:46.667533 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-44f59870-6f52-4a82-8310-8fed0752767f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.185789 Aug 01 07:37:46.668125 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 43/87] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:46 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:46.677853 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-09734ebe-1295-4988-bfa4-44e32b3d662f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:46.678493 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-09734ebe-1295-4988-bfa4-44e32b3d662f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:46.689882 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-09734ebe-1295-4988-bfa4-44e32b3d662f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:46.690570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-09734ebe-1295-4988-bfa4-44e32b3d662f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:46.691442 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-09734ebe-1295-4988-bfa4-44e32b3d662f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:46.692004 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-09734ebe-1295-4988-bfa4-44e32b3d662f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:46.758958 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-09734ebe-1295-4988-bfa4-44e32b3d662f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:46.766555 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-09734ebe-1295-4988-bfa4-44e32b3d662f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.093192 Aug 01 07:37:46.767159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 45/88] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:46 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:47.304904 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-92009649-8243-42ad-9623-ef4174b79924 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:47.305638 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-92009649-8243-42ad-9623-ef4174b79924 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:47.312662 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-92009649-8243-42ad-9623-ef4174b79924 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:47.313587 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-92009649-8243-42ad-9623-ef4174b79924 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:47.314879 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-92009649-8243-42ad-9623-ef4174b79924 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:47.315506 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-92009649-8243-42ad-9623-ef4174b79924 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:47.405950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-92009649-8243-42ad-9623-ef4174b79924 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:47.419732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-92009649-8243-42ad-9623-ef4174b79924 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.119447 Aug 01 07:37:47.432166 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 44/89] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:47 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:47.440480 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-156860b6-cd49-4a5e-9377-e98d2f6f4e65 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:47.440972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-156860b6-cd49-4a5e-9377-e98d2f6f4e65 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:47.460049 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-156860b6-cd49-4a5e-9377-e98d2f6f4e65 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:47.463742 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-156860b6-cd49-4a5e-9377-e98d2f6f4e65 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:47.465260 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-156860b6-cd49-4a5e-9377-e98d2f6f4e65 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:47.475375 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-156860b6-cd49-4a5e-9377-e98d2f6f4e65 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:47.675609 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-156860b6-cd49-4a5e-9377-e98d2f6f4e65 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:47.687401 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-156860b6-cd49-4a5e-9377-e98d2f6f4e65 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:47.690200 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-156860b6-cd49-4a5e-9377-e98d2f6f4e65 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:47.691798 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-156860b6-cd49-4a5e-9377-e98d2f6f4e65 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1334 microversion: 2.20 time: 0.255252 Aug 01 07:37:47.701022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8a798a94-3445-4f25-9c8f-e8707a87ffb3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:47.701022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8a798a94-3445-4f25-9c8f-e8707a87ffb3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:47.703436 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 46/90] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:47 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1334 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:37:47.710581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8a798a94-3445-4f25-9c8f-e8707a87ffb3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:47.711042 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8a798a94-3445-4f25-9c8f-e8707a87ffb3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:47.711853 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8a798a94-3445-4f25-9c8f-e8707a87ffb3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:47.714120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8a798a94-3445-4f25-9c8f-e8707a87ffb3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:47.790745 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-80a681c6-dcf8-496d-a8f8-abdff68d498e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:47.791367 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-80a681c6-dcf8-496d-a8f8-abdff68d498e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:47.797531 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-80a681c6-dcf8-496d-a8f8-abdff68d498e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:47.797975 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-80a681c6-dcf8-496d-a8f8-abdff68d498e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:47.798782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-80a681c6-dcf8-496d-a8f8-abdff68d498e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:47.799246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-80a681c6-dcf8-496d-a8f8-abdff68d498e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:47.879196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8a798a94-3445-4f25-9c8f-e8707a87ffb3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:47.900161 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-80a681c6-dcf8-496d-a8f8-abdff68d498e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:47.901583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8a798a94-3445-4f25-9c8f-e8707a87ffb3 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.216003 Aug 01 07:37:47.908801 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-80a681c6-dcf8-496d-a8f8-abdff68d498e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.122734 Aug 01 07:37:47.923771 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 45/91] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:47 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:47.924344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 47/92] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:47 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:48.445305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7164f945-3cf9-4064-a481-b0d252be65dc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:48.445925 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7164f945-3cf9-4064-a481-b0d252be65dc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:48.452012 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7164f945-3cf9-4064-a481-b0d252be65dc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:48.452464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7164f945-3cf9-4064-a481-b0d252be65dc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:48.453230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7164f945-3cf9-4064-a481-b0d252be65dc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:48.453684 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7164f945-3cf9-4064-a481-b0d252be65dc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:48.516158 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7164f945-3cf9-4064-a481-b0d252be65dc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:48.524200 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7164f945-3cf9-4064-a481-b0d252be65dc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.082762 Aug 01 07:37:48.524769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 46/93] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:48 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:48.719114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e9b14805-d0e2-416f-9d0e-cedc1bfc4bb5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:48.719712 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e9b14805-d0e2-416f-9d0e-cedc1bfc4bb5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:48.746231 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e9b14805-d0e2-416f-9d0e-cedc1bfc4bb5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:48.750309 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e9b14805-d0e2-416f-9d0e-cedc1bfc4bb5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:48.755511 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e9b14805-d0e2-416f-9d0e-cedc1bfc4bb5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:48.759149 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e9b14805-d0e2-416f-9d0e-cedc1bfc4bb5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:48.912460 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e9b14805-d0e2-416f-9d0e-cedc1bfc4bb5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:48.926128 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e9b14805-d0e2-416f-9d0e-cedc1bfc4bb5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:48.928134 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e9b14805-d0e2-416f-9d0e-cedc1bfc4bb5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:48.929622 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e99cfab2-02fa-491f-b715-a2f91a655717 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:48.930255 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e99cfab2-02fa-491f-b715-a2f91a655717 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:48.940162 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e99cfab2-02fa-491f-b715-a2f91a655717 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:48.943520 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e99cfab2-02fa-491f-b715-a2f91a655717 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:48.944868 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e99cfab2-02fa-491f-b715-a2f91a655717 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:48.946838 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e99cfab2-02fa-491f-b715-a2f91a655717 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:48.954004 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e9b14805-d0e2-416f-9d0e-cedc1bfc4bb5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1342 microversion: 2.20 time: 0.231465 Aug 01 07:37:48.954309 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 48/94] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:48 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1342 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:48.962946 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-25aa7efe-c5a9-4697-8903-53dc35dfb7ad tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:48.986178 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-25aa7efe-c5a9-4697-8903-53dc35dfb7ad tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:49.004269 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-25aa7efe-c5a9-4697-8903-53dc35dfb7ad tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:49.007271 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-25aa7efe-c5a9-4697-8903-53dc35dfb7ad tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:49.011675 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-25aa7efe-c5a9-4697-8903-53dc35dfb7ad tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:49.013804 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-25aa7efe-c5a9-4697-8903-53dc35dfb7ad tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:49.169081 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-25aa7efe-c5a9-4697-8903-53dc35dfb7ad tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:49.182006 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-25aa7efe-c5a9-4697-8903-53dc35dfb7ad tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.226515 Aug 01 07:37:49.183133 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 49/95] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:48 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:49.547952 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a7012a61-624f-44fc-8bb2-ddf5c0e3f03c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:49.548673 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a7012a61-624f-44fc-8bb2-ddf5c0e3f03c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:49.562558 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a7012a61-624f-44fc-8bb2-ddf5c0e3f03c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:49.563173 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a7012a61-624f-44fc-8bb2-ddf5c0e3f03c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:49.570215 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a7012a61-624f-44fc-8bb2-ddf5c0e3f03c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:49.570680 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a7012a61-624f-44fc-8bb2-ddf5c0e3f03c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:49.703357 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a7012a61-624f-44fc-8bb2-ddf5c0e3f03c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:49.716065 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a7012a61-624f-44fc-8bb2-ddf5c0e3f03c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1296 microversion: 2.1 time: 0.173183 Aug 01 07:37:49.717591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 50/96] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:49 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1296 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:49.772588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e99cfab2-02fa-491f-b715-a2f91a655717 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:49.785733 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e99cfab2-02fa-491f-b715-a2f91a655717 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.861176 Aug 01 07:37:49.789151 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 47/97] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:48 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:49.985255 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ba259e81-1113-4f21-95b8-f1afd7c8a9d5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:49.986359 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ba259e81-1113-4f21-95b8-f1afd7c8a9d5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:49.992933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba259e81-1113-4f21-95b8-f1afd7c8a9d5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:49.993737 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba259e81-1113-4f21-95b8-f1afd7c8a9d5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:49.994731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba259e81-1113-4f21-95b8-f1afd7c8a9d5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:49.995417 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba259e81-1113-4f21-95b8-f1afd7c8a9d5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:50.162712 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ba259e81-1113-4f21-95b8-f1afd7c8a9d5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:50.166093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=100 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:50.176274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ba259e81-1113-4f21-95b8-f1afd7c8a9d5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:50.177951 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ba259e81-1113-4f21-95b8-f1afd7c8a9d5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:50.179055 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ba259e81-1113-4f21-95b8-f1afd7c8a9d5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.198326 Aug 01 07:37:50.179821 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 51/98] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:49 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:50.206743 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-83d9a7c4-53d8-49e9-b7bd-3c5bc2e844eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:50.207469 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-83d9a7c4-53d8-49e9-b7bd-3c5bc2e844eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:50.214926 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-83d9a7c4-53d8-49e9-b7bd-3c5bc2e844eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:50.215500 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-83d9a7c4-53d8-49e9-b7bd-3c5bc2e844eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:50.216655 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-83d9a7c4-53d8-49e9-b7bd-3c5bc2e844eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:50.217104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-83d9a7c4-53d8-49e9-b7bd-3c5bc2e844eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:50.357551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-83d9a7c4-53d8-49e9-b7bd-3c5bc2e844eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:50.365781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-83d9a7c4-53d8-49e9-b7bd-3c5bc2e844eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1280 microversion: 2.1 time: 0.163703 Aug 01 07:37:50.366594 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 48/99] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:50 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:50.738215 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8e711dab-bedf-434c-88a2-949ccf14649d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:50.738837 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8e711dab-bedf-434c-88a2-949ccf14649d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:50.757036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8e711dab-bedf-434c-88a2-949ccf14649d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:50.757504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8e711dab-bedf-434c-88a2-949ccf14649d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:50.759666 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8e711dab-bedf-434c-88a2-949ccf14649d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:50.760614 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8e711dab-bedf-434c-88a2-949ccf14649d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:50.808223 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b9ca1ecb-5966-4d64-827c-9e3f2bb0b4f4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:50.809432 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b9ca1ecb-5966-4d64-827c-9e3f2bb0b4f4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:50.819798 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b9ca1ecb-5966-4d64-827c-9e3f2bb0b4f4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:50.826381 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b9ca1ecb-5966-4d64-827c-9e3f2bb0b4f4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:50.827775 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b9ca1ecb-5966-4d64-827c-9e3f2bb0b4f4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:50.828435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b9ca1ecb-5966-4d64-827c-9e3f2bb0b4f4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:50.985178 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8e711dab-bedf-434c-88a2-949ccf14649d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:51.001604 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8e711dab-bedf-434c-88a2-949ccf14649d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.267004 Aug 01 07:37:51.003308 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 52/100] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:50 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:51.204254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-438d6ca8-0195-4452-a2fa-57595d553ecd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:51.204936 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-438d6ca8-0195-4452-a2fa-57595d553ecd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:51.214463 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-438d6ca8-0195-4452-a2fa-57595d553ecd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:51.215239 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-438d6ca8-0195-4452-a2fa-57595d553ecd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:51.216194 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-438d6ca8-0195-4452-a2fa-57595d553ecd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:51.216785 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-438d6ca8-0195-4452-a2fa-57595d553ecd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:51.306630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b9ca1ecb-5966-4d64-827c-9e3f2bb0b4f4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:51.320847 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b9ca1ecb-5966-4d64-827c-9e3f2bb0b4f4 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.517025 Aug 01 07:37:51.331106 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 49/101] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:50 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:51.386732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-eb396961-72f5-47dc-8682-fb67aa74f686 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:51.387436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-eb396961-72f5-47dc-8682-fb67aa74f686 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:51.393364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eb396961-72f5-47dc-8682-fb67aa74f686 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:51.393808 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eb396961-72f5-47dc-8682-fb67aa74f686 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:51.394977 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eb396961-72f5-47dc-8682-fb67aa74f686 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:51.395959 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eb396961-72f5-47dc-8682-fb67aa74f686 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:51.420462 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-438d6ca8-0195-4452-a2fa-57595d553ecd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:51.438511 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-438d6ca8-0195-4452-a2fa-57595d553ecd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:51.443302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-438d6ca8-0195-4452-a2fa-57595d553ecd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:51.444894 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-438d6ca8-0195-4452-a2fa-57595d553ecd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.244645 Aug 01 07:37:51.455468 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 53/102] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:51 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:51.888707 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-eb396961-72f5-47dc-8682-fb67aa74f686 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:51.902366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-eb396961-72f5-47dc-8682-fb67aa74f686 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.519346 Aug 01 07:37:51.904674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 50/103] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:51 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:51.950447 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-ee393c9d-97c6-4d9c-ba51-f7606bf1bd1d req-07fec437-e829-45c4-b097-5810623e49fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dcc6cbc-c57a-466f-b00b-f4d74fe85eda", "tag": "10a1e2ea-e7a8-494f-a680-579c506cdb2b"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:51.970926 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-ee393c9d-97c6-4d9c-ba51-f7606bf1bd1d req-07fec437-e829-45c4-b097-5810623e49fa service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:51.971401 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-ee393c9d-97c6-4d9c-ba51-f7606bf1bd1d req-07fec437-e829-45c4-b097-5810623e49fa service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:51.995195 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-ee393c9d-97c6-4d9c-ba51-f7606bf1bd1d req-07fec437-e829-45c4-b097-5810623e49fa service nova] Creating event network-changed:10a1e2ea-e7a8-494f-a680-579c506cdb2b for instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda on hv-cinder-73306 Aug 01 07:37:51.995738 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-ee393c9d-97c6-4d9c-ba51-f7606bf1bd1d req-07fec437-e829-45c4-b097-5810623e49fa service nova] Acquired lock "compute-rpcapi-router" {{(pid=124279) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 07:37:51.996869 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6d880c7a-98f7-4902-a411-3263d61956f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:51.997400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6d880c7a-98f7-4902-a411-3263d61956f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:51.998377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6d880c7a-98f7-4902-a411-3263d61956f3 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:51.998978 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6d880c7a-98f7-4902-a411-3263d61956f3 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:52.009507 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.compute.rpcapi [None req-6d880c7a-98f7-4902-a411-3263d61956f3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 07:37:52.010391 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6d880c7a-98f7-4902-a411-3263d61956f3 None None] Releasing lock "compute-rpcapi-router" {{(pid=124279) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 07:37:52.024656 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-35999cc8-9b3f-4f65-89cb-8b49d6857139 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:52.025568 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-35999cc8-9b3f-4f65-89cb-8b49d6857139 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:52.033747 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35999cc8-9b3f-4f65-89cb-8b49d6857139 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:52.034585 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6d880c7a-98f7-4902-a411-3263d61956f3 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167909 Aug 01 07:37:52.034708 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35999cc8-9b3f-4f65-89cb-8b49d6857139 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:52.035775 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35999cc8-9b3f-4f65-89cb-8b49d6857139 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:52.036890 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35999cc8-9b3f-4f65-89cb-8b49d6857139 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:52.038953 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 54/104] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:52.196157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-35999cc8-9b3f-4f65-89cb-8b49d6857139 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:52.203953 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-35999cc8-9b3f-4f65-89cb-8b49d6857139 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.184293 Aug 01 07:37:52.204528 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 51/105] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:52 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:52.343234 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0abb1edb-731f-4303-a2ed-9371c79e7f6e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:52.344280 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0abb1edb-731f-4303-a2ed-9371c79e7f6e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:52.352393 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0abb1edb-731f-4303-a2ed-9371c79e7f6e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:52.353321 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0abb1edb-731f-4303-a2ed-9371c79e7f6e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:52.354449 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0abb1edb-731f-4303-a2ed-9371c79e7f6e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:52.354952 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0abb1edb-731f-4303-a2ed-9371c79e7f6e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:52.469828 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-41f4c3d6-d4f3-4cde-85b8-2428dc383541 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:52.470560 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-41f4c3d6-d4f3-4cde-85b8-2428dc383541 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:52.477211 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41f4c3d6-d4f3-4cde-85b8-2428dc383541 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:52.477732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41f4c3d6-d4f3-4cde-85b8-2428dc383541 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:52.478561 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41f4c3d6-d4f3-4cde-85b8-2428dc383541 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:52.479077 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41f4c3d6-d4f3-4cde-85b8-2428dc383541 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:52.549707 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0abb1edb-731f-4303-a2ed-9371c79e7f6e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:52.560018 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0abb1edb-731f-4303-a2ed-9371c79e7f6e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.221494 Aug 01 07:37:52.560701 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 55/106] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:52 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:52.907777 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-41f4c3d6-d4f3-4cde-85b8-2428dc383541 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:52.921459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-41f4c3d6-d4f3-4cde-85b8-2428dc383541 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:52.923004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-41f4c3d6-d4f3-4cde-85b8-2428dc383541 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:52.924144 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-73bca0e9-9d28-4cf6-b690-1ef9715c4931 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:52.924856 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-73bca0e9-9d28-4cf6-b690-1ef9715c4931 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:52.927763 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-41f4c3d6-d4f3-4cde-85b8-2428dc383541 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.461637 Aug 01 07:37:52.928562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 52/107] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:52 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:37:52.947769 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-73bca0e9-9d28-4cf6-b690-1ef9715c4931 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:52.948394 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-73bca0e9-9d28-4cf6-b690-1ef9715c4931 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:52.949369 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-73bca0e9-9d28-4cf6-b690-1ef9715c4931 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:52.949949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-73bca0e9-9d28-4cf6-b690-1ef9715c4931 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:53.221014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-73bca0e9-9d28-4cf6-b690-1ef9715c4931 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:53.225832 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-17ef5be0-acf8-45d9-afbd-2fbbbe8b1f81 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:53.226657 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-17ef5be0-acf8-45d9-afbd-2fbbbe8b1f81 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:53.234264 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-17ef5be0-acf8-45d9-afbd-2fbbbe8b1f81 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:53.240141 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-73bca0e9-9d28-4cf6-b690-1ef9715c4931 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.320197 Aug 01 07:37:53.241405 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 56/108] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:52 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:53.251423 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-17ef5be0-acf8-45d9-afbd-2fbbbe8b1f81 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:53.252273 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-17ef5be0-acf8-45d9-afbd-2fbbbe8b1f81 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:53.252725 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-17ef5be0-acf8-45d9-afbd-2fbbbe8b1f81 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:53.586476 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2f9bee15-e1b4-4307-b664-d916e0a0402c tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:53.587942 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2f9bee15-e1b4-4307-b664-d916e0a0402c tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:53.598689 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f9bee15-e1b4-4307-b664-d916e0a0402c tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:53.599258 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f9bee15-e1b4-4307-b664-d916e0a0402c tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:53.600043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f9bee15-e1b4-4307-b664-d916e0a0402c tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:53.600483 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f9bee15-e1b4-4307-b664-d916e0a0402c tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:54.181889 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2f9bee15-e1b4-4307-b664-d916e0a0402c tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:54.194732 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2f9bee15-e1b4-4307-b664-d916e0a0402c tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.613616 Aug 01 07:37:54.196063 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 57/109] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:53 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:54.212323 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6df89bd0-04a1-4c07-9101-53e189d0cd06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:54.213828 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6df89bd0-04a1-4c07-9101-53e189d0cd06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:54.222522 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6df89bd0-04a1-4c07-9101-53e189d0cd06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:54.224083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6df89bd0-04a1-4c07-9101-53e189d0cd06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:54.225884 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6df89bd0-04a1-4c07-9101-53e189d0cd06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:54.226791 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6df89bd0-04a1-4c07-9101-53e189d0cd06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:54.531549 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6df89bd0-04a1-4c07-9101-53e189d0cd06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:54.540632 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6df89bd0-04a1-4c07-9101-53e189d0cd06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:54.542529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6df89bd0-04a1-4c07-9101-53e189d0cd06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:54.544156 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6df89bd0-04a1-4c07-9101-53e189d0cd06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.346924 Aug 01 07:37:54.545268 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 58/110] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:54 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:54.729819 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-08702052-067f-427f-8d54-5e7b4dc7952c req-75b78c10-f6c9-4f4a-b44e-179ec8f157dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff143cc-5a30-44be-a327-29eaacf61348", "tag": "7b59d41d-43d0-4098-917e-f7635e0051db"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:54.741590 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-08702052-067f-427f-8d54-5e7b4dc7952c req-75b78c10-f6c9-4f4a-b44e-179ec8f157dc service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:54.742513 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-08702052-067f-427f-8d54-5e7b4dc7952c req-75b78c10-f6c9-4f4a-b44e-179ec8f157dc service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:54.763196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-08702052-067f-427f-8d54-5e7b4dc7952c req-75b78c10-f6c9-4f4a-b44e-179ec8f157dc service nova] Creating event network-changed:7b59d41d-43d0-4098-917e-f7635e0051db for instance 8ff143cc-5a30-44be-a327-29eaacf61348 on hv-cinder-73306 Aug 01 07:37:54.769462 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-08702052-067f-427f-8d54-5e7b4dc7952c req-75b78c10-f6c9-4f4a-b44e-179ec8f157dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221853 Aug 01 07:37:54.771636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 59/111] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:54.777689 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-17ef5be0-acf8-45d9-afbd-2fbbbe8b1f81 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:54.781860 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-8a30e4e6-830b-4ac1-b5d7-ff98ab393f83 req-06dea200-b1c7-4650-adca-774ca57fe210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ee0c72-d5d4-4b77-a434-b3fbbaeae13e", "tag": "d5e19417-4c11-464d-a9fa-6ac51f3c5660"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:54.792506 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-8a30e4e6-830b-4ac1-b5d7-ff98ab393f83 req-06dea200-b1c7-4650-adca-774ca57fe210 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:54.793178 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-8a30e4e6-830b-4ac1-b5d7-ff98ab393f83 req-06dea200-b1c7-4650-adca-774ca57fe210 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:54.806065 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-8a30e4e6-830b-4ac1-b5d7-ff98ab393f83 req-06dea200-b1c7-4650-adca-774ca57fe210 service nova] Creating event network-changed:d5e19417-4c11-464d-a9fa-6ac51f3c5660 for instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e on hv-cinder-73306 Aug 01 07:37:54.812383 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-8a30e4e6-830b-4ac1-b5d7-ff98ab393f83 req-06dea200-b1c7-4650-adca-774ca57fe210 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039132 Aug 01 07:37:54.813524 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 60/112] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:54.820114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f06238b3-ef5f-4e55-91cc-3f32fd341b9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:54.821162 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f06238b3-ef5f-4e55-91cc-3f32fd341b9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:54.829636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f06238b3-ef5f-4e55-91cc-3f32fd341b9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:54.830487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f06238b3-ef5f-4e55-91cc-3f32fd341b9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:54.831600 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f06238b3-ef5f-4e55-91cc-3f32fd341b9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:54.832316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f06238b3-ef5f-4e55-91cc-3f32fd341b9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:54.839716 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-17ef5be0-acf8-45d9-afbd-2fbbbe8b1f81 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 1.611406 Aug 01 07:37:54.863315 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 53/113] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:53 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:55.090380 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f06238b3-ef5f-4e55-91cc-3f32fd341b9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:55.100623 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f06238b3-ef5f-4e55-91cc-3f32fd341b9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.285359 Aug 01 07:37:55.101540 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 61/114] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:54 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:55.217278 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-05e3aeb8-50c3-4aba-a32a-c174d3d71cca tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:55.218135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-05e3aeb8-50c3-4aba-a32a-c174d3d71cca tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:55.231878 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05e3aeb8-50c3-4aba-a32a-c174d3d71cca tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:55.232336 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05e3aeb8-50c3-4aba-a32a-c174d3d71cca tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:55.233251 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05e3aeb8-50c3-4aba-a32a-c174d3d71cca tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:55.233545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05e3aeb8-50c3-4aba-a32a-c174d3d71cca tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:55.510092 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-05e3aeb8-50c3-4aba-a32a-c174d3d71cca tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:55.526611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-05e3aeb8-50c3-4aba-a32a-c174d3d71cca tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.313654 Aug 01 07:37:55.531341 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 54/115] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:55 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:55.569549 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b1debe78-d1c4-4f1e-bd15-aaedc94b852a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:55.570145 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b1debe78-d1c4-4f1e-bd15-aaedc94b852a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:55.585371 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1debe78-d1c4-4f1e-bd15-aaedc94b852a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:55.585894 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1debe78-d1c4-4f1e-bd15-aaedc94b852a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:55.586623 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1debe78-d1c4-4f1e-bd15-aaedc94b852a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:55.587157 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1debe78-d1c4-4f1e-bd15-aaedc94b852a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:55.763295 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b1debe78-d1c4-4f1e-bd15-aaedc94b852a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:55.772305 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b1debe78-d1c4-4f1e-bd15-aaedc94b852a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:55.774121 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b1debe78-d1c4-4f1e-bd15-aaedc94b852a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:55.775253 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b1debe78-d1c4-4f1e-bd15-aaedc94b852a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.209694 Aug 01 07:37:55.775818 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 62/116] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:55 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:55.864464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a1f50762-12d7-45bf-8c45-023b26c44c2f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:55.865078 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a1f50762-12d7-45bf-8c45-023b26c44c2f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:55.871004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a1f50762-12d7-45bf-8c45-023b26c44c2f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:55.871534 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a1f50762-12d7-45bf-8c45-023b26c44c2f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:55.872293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a1f50762-12d7-45bf-8c45-023b26c44c2f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:55.872730 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a1f50762-12d7-45bf-8c45-023b26c44c2f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:56.082527 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a1f50762-12d7-45bf-8c45-023b26c44c2f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:56.086089 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:37:56.091393 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a1f50762-12d7-45bf-8c45-023b26c44c2f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.230955 Aug 01 07:37:56.091960 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 55/117] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:55 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:56.121913 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3bbff594-c4b7-4afe-8b97-aeca1d2a3f86 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:56.122507 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3bbff594-c4b7-4afe-8b97-aeca1d2a3f86 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:56.128440 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3bbff594-c4b7-4afe-8b97-aeca1d2a3f86 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:56.128885 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3bbff594-c4b7-4afe-8b97-aeca1d2a3f86 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:56.130478 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3bbff594-c4b7-4afe-8b97-aeca1d2a3f86 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:56.130880 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3bbff594-c4b7-4afe-8b97-aeca1d2a3f86 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:56.267574 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3bbff594-c4b7-4afe-8b97-aeca1d2a3f86 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:56.276495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3bbff594-c4b7-4afe-8b97-aeca1d2a3f86 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.158139 Aug 01 07:37:56.277218 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 63/118] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:56 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:56.552672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-464abc86-a59b-49bf-8651-e73deb0018ce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:56.553460 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-464abc86-a59b-49bf-8651-e73deb0018ce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:56.559461 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-464abc86-a59b-49bf-8651-e73deb0018ce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:56.560253 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-464abc86-a59b-49bf-8651-e73deb0018ce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:56.560885 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-464abc86-a59b-49bf-8651-e73deb0018ce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:56.561321 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-464abc86-a59b-49bf-8651-e73deb0018ce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:56.709093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-464abc86-a59b-49bf-8651-e73deb0018ce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:56.719821 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-464abc86-a59b-49bf-8651-e73deb0018ce tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.172421 Aug 01 07:37:56.720917 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 56/119] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:56 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:56.798865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8dca3783-6276-45f0-8ec4-e46b39ac7c85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:56.799674 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8dca3783-6276-45f0-8ec4-e46b39ac7c85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:56.810279 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8dca3783-6276-45f0-8ec4-e46b39ac7c85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:56.813380 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8dca3783-6276-45f0-8ec4-e46b39ac7c85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:56.820420 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8dca3783-6276-45f0-8ec4-e46b39ac7c85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:56.823489 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8dca3783-6276-45f0-8ec4-e46b39ac7c85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:56.941404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-9836620b-50ea-41fb-80e9-daba5fe13ff4 req-57ea2db4-3efd-4836-b2c7-ffcefd33f8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48863078-f7de-4370-af9c-4bdba932b5c3", "tag": "e56c66fd-c11c-4962-a9be-c8b351d26751"}, {"name": "network-changed", "server_uuid": "451a7361-81eb-4f1b-be18-1f144f037202", "tag": "50575a60-bea2-40e1-a490-a7dc71582936"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:56.971998 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-9836620b-50ea-41fb-80e9-daba5fe13ff4 req-57ea2db4-3efd-4836-b2c7-ffcefd33f8e5 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:56.972765 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-9836620b-50ea-41fb-80e9-daba5fe13ff4 req-57ea2db4-3efd-4836-b2c7-ffcefd33f8e5 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:57.026023 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-9836620b-50ea-41fb-80e9-daba5fe13ff4 req-57ea2db4-3efd-4836-b2c7-ffcefd33f8e5 service nova] Creating event network-changed:e56c66fd-c11c-4962-a9be-c8b351d26751 for instance 48863078-f7de-4370-af9c-4bdba932b5c3 on hv-cinder-73306 Aug 01 07:37:57.027048 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-9836620b-50ea-41fb-80e9-daba5fe13ff4 req-57ea2db4-3efd-4836-b2c7-ffcefd33f8e5 service nova] Creating event network-changed:50575a60-bea2-40e1-a490-a7dc71582936 for instance 451a7361-81eb-4f1b-be18-1f144f037202 on hv-cinder-73306 Aug 01 07:37:57.027751 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-9836620b-50ea-41fb-80e9-daba5fe13ff4 req-57ea2db4-3efd-4836-b2c7-ffcefd33f8e5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124280) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 07:37:57.031547 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a675aaab-a285-41d3-a587-4b7d8ca870c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:57.031670 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a675aaab-a285-41d3-a587-4b7d8ca870c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:57.046871 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a675aaab-a285-41d3-a587-4b7d8ca870c4 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:57.046871 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a675aaab-a285-41d3-a587-4b7d8ca870c4 None None] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:57.046871 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.compute.rpcapi [None req-a675aaab-a285-41d3-a587-4b7d8ca870c4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 07:37:57.046871 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a675aaab-a285-41d3-a587-4b7d8ca870c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=124280) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 07:37:57.122357 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a675aaab-a285-41d3-a587-4b7d8ca870c4 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.185005 Aug 01 07:37:57.123302 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 57/120] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:37:57.146224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-60c157d9-3109-4de1-a4a6-19350da06fe6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:57.161040 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-60c157d9-3109-4de1-a4a6-19350da06fe6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:57.179044 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-60c157d9-3109-4de1-a4a6-19350da06fe6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:57.180186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-60c157d9-3109-4de1-a4a6-19350da06fe6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:57.183607 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-60c157d9-3109-4de1-a4a6-19350da06fe6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:57.187485 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-60c157d9-3109-4de1-a4a6-19350da06fe6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:57.363495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8dca3783-6276-45f0-8ec4-e46b39ac7c85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:57.374314 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8dca3783-6276-45f0-8ec4-e46b39ac7c85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:57.376414 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8dca3783-6276-45f0-8ec4-e46b39ac7c85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:57.378102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8dca3783-6276-45f0-8ec4-e46b39ac7c85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.583756 Aug 01 07:37:57.381104 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 64/121] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:56 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:57.389186 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-28b7f71a-aca2-4493-8305-3575f9b22c40 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:57.390340 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-28b7f71a-aca2-4493-8305-3575f9b22c40 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:57.399791 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-28b7f71a-aca2-4493-8305-3575f9b22c40 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:57.400847 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-28b7f71a-aca2-4493-8305-3575f9b22c40 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:57.402995 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-28b7f71a-aca2-4493-8305-3575f9b22c40 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:57.404202 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-28b7f71a-aca2-4493-8305-3575f9b22c40 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:57.676888 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-28b7f71a-aca2-4493-8305-3575f9b22c40 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:57.685307 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-28b7f71a-aca2-4493-8305-3575f9b22c40 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.301912 Aug 01 07:37:57.686191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 65/122] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:57 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:57.747415 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ad548a7a-d328-4450-8a10-41b2fe0ace02 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:57.748345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ad548a7a-d328-4450-8a10-41b2fe0ace02 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:57.756140 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ad548a7a-d328-4450-8a10-41b2fe0ace02 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:57.756734 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ad548a7a-d328-4450-8a10-41b2fe0ace02 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:57.757622 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ad548a7a-d328-4450-8a10-41b2fe0ace02 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:57.758167 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ad548a7a-d328-4450-8a10-41b2fe0ace02 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:57.925345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ad548a7a-d328-4450-8a10-41b2fe0ace02 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:57.934297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ad548a7a-d328-4450-8a10-41b2fe0ace02 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.191462 Aug 01 07:37:57.934931 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 66/123] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:57 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:58.060413 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-60c157d9-3109-4de1-a4a6-19350da06fe6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:58.068032 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-60c157d9-3109-4de1-a4a6-19350da06fe6 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.941781 Aug 01 07:37:58.068605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 58/124] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:57 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:58.421419 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-651d94fb-2f0d-4255-a039-1cb820d45f30 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:58.422302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-651d94fb-2f0d-4255-a039-1cb820d45f30 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:58.431091 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-651d94fb-2f0d-4255-a039-1cb820d45f30 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:58.431544 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-651d94fb-2f0d-4255-a039-1cb820d45f30 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:58.432317 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-651d94fb-2f0d-4255-a039-1cb820d45f30 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:58.432755 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-651d94fb-2f0d-4255-a039-1cb820d45f30 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:58.718770 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5d76fc30-4916-49b4-8420-7154ccaeb383 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:58.719638 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5d76fc30-4916-49b4-8420-7154ccaeb383 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:58.766742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5d76fc30-4916-49b4-8420-7154ccaeb383 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:58.769517 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5d76fc30-4916-49b4-8420-7154ccaeb383 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:58.775166 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5d76fc30-4916-49b4-8420-7154ccaeb383 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:58.777565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5d76fc30-4916-49b4-8420-7154ccaeb383 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:58.902771 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-651d94fb-2f0d-4255-a039-1cb820d45f30 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:58.916444 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-651d94fb-2f0d-4255-a039-1cb820d45f30 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:58.918437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-651d94fb-2f0d-4255-a039-1cb820d45f30 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:58.920135 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-651d94fb-2f0d-4255-a039-1cb820d45f30 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.503937 Aug 01 07:37:58.921089 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 67/125] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:58 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:37:58.963510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-824c1968-83c2-4578-95f0-0ffbe43d0f6a tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:58.964160 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-824c1968-83c2-4578-95f0-0ffbe43d0f6a tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:58.971211 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-824c1968-83c2-4578-95f0-0ffbe43d0f6a tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:58.971671 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-824c1968-83c2-4578-95f0-0ffbe43d0f6a tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:58.976031 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-824c1968-83c2-4578-95f0-0ffbe43d0f6a tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:58.976031 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-824c1968-83c2-4578-95f0-0ffbe43d0f6a tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:59.048991 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5d76fc30-4916-49b4-8420-7154ccaeb383 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:59.058997 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5d76fc30-4916-49b4-8420-7154ccaeb383 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.354967 Aug 01 07:37:59.072179 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 59/126] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:58 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:59.097350 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-79a76b55-850f-4909-9183-efa78e5659c2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:59.098349 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-79a76b55-850f-4909-9183-efa78e5659c2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:59.108762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-79a76b55-850f-4909-9183-efa78e5659c2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:59.109602 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-79a76b55-850f-4909-9183-efa78e5659c2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:59.110441 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-79a76b55-850f-4909-9183-efa78e5659c2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:59.110891 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-79a76b55-850f-4909-9183-efa78e5659c2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:59.215016 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-824c1968-83c2-4578-95f0-0ffbe43d0f6a tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:59.225212 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-824c1968-83c2-4578-95f0-0ffbe43d0f6a tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.273247 Aug 01 07:37:59.231490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 68/127] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:58 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:37:59.283337 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-79a76b55-850f-4909-9183-efa78e5659c2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:37:59.292069 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-79a76b55-850f-4909-9183-efa78e5659c2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.207155 Aug 01 07:37:59.293702 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 60/128] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:37:59 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:37:59.518359 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-da904508-1afa-463f-8e91-694a016e487d req-460b0a22-15c0-4efc-a2de-6a1e3daa5e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ee0c72-d5d4-4b77-a434-b3fbbaeae13e", "name": "network-vif-plugged", "status": "completed", "tag": "d5e19417-4c11-464d-a9fa-6ac51f3c5660"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:37:59.528529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-da904508-1afa-463f-8e91-694a016e487d req-460b0a22-15c0-4efc-a2de-6a1e3daa5e1c service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:59.529278 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-da904508-1afa-463f-8e91-694a016e487d req-460b0a22-15c0-4efc-a2de-6a1e3daa5e1c service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:59.543487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-da904508-1afa-463f-8e91-694a016e487d req-460b0a22-15c0-4efc-a2de-6a1e3daa5e1c service nova] Creating event network-vif-plugged:d5e19417-4c11-464d-a9fa-6ac51f3c5660 for instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e on hv-cinder-73306 Aug 01 07:37:59.549876 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-da904508-1afa-463f-8e91-694a016e487d req-460b0a22-15c0-4efc-a2de-6a1e3daa5e1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106452 Aug 01 07:37:59.550813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 69/129] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:37:59.942753 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-33937800-60c9-4635-9524-d19db0de34d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:37:59.943436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-33937800-60c9-4635-9524-d19db0de34d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:37:59.955578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-33937800-60c9-4635-9524-d19db0de34d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:59.956028 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-33937800-60c9-4635-9524-d19db0de34d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:37:59.957004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-33937800-60c9-4635-9524-d19db0de34d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:37:59.958066 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-33937800-60c9-4635-9524-d19db0de34d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:00.085670 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-cd7ef163-2851-494d-bdbe-5a869aea9c61 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:00.087762 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-cd7ef163-2851-494d-bdbe-5a869aea9c61 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:00.103804 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cd7ef163-2851-494d-bdbe-5a869aea9c61 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:00.104454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cd7ef163-2851-494d-bdbe-5a869aea9c61 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:00.105227 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cd7ef163-2851-494d-bdbe-5a869aea9c61 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:00.105708 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cd7ef163-2851-494d-bdbe-5a869aea9c61 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:00.211833 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-33937800-60c9-4635-9524-d19db0de34d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:00.221666 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-33937800-60c9-4635-9524-d19db0de34d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:00.225663 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-33937800-60c9-4635-9524-d19db0de34d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:00.228041 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-33937800-60c9-4635-9524-d19db0de34d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.289168 Aug 01 07:38:00.233202 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 61/130] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:37:59 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:38:00.245823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-420e95ff-20c0-43eb-be80-a08a4e16a686 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:00.247026 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-420e95ff-20c0-43eb-be80-a08a4e16a686 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:00.255649 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-420e95ff-20c0-43eb-be80-a08a4e16a686 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:00.257138 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-420e95ff-20c0-43eb-be80-a08a4e16a686 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:00.257932 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-420e95ff-20c0-43eb-be80-a08a4e16a686 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:00.258373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-420e95ff-20c0-43eb-be80-a08a4e16a686 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:00.348852 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-cd7ef163-2851-494d-bdbe-5a869aea9c61 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:00.353191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=100 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:00.359798 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-cd7ef163-2851-494d-bdbe-5a869aea9c61 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.280955 Aug 01 07:38:00.360793 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 70/131] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:00 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:00.375811 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c800cf17-b4e6-4f5e-bf44-d13e672ce6f9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:00.376742 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c800cf17-b4e6-4f5e-bf44-d13e672ce6f9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:00.387306 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c800cf17-b4e6-4f5e-bf44-d13e672ce6f9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:00.388380 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c800cf17-b4e6-4f5e-bf44-d13e672ce6f9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:00.389202 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c800cf17-b4e6-4f5e-bf44-d13e672ce6f9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:00.389783 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c800cf17-b4e6-4f5e-bf44-d13e672ce6f9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:00.452455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-420e95ff-20c0-43eb-be80-a08a4e16a686 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:00.468156 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-420e95ff-20c0-43eb-be80-a08a4e16a686 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.225191 Aug 01 07:38:00.468918 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 62/132] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:00 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:00.566875 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c800cf17-b4e6-4f5e-bf44-d13e672ce6f9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:00.576535 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c800cf17-b4e6-4f5e-bf44-d13e672ce6f9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.212718 Aug 01 07:38:00.577549 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 71/133] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:00 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:01.259102 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5caba378-77a0-405f-8629-067d7a9a1cd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:01.259658 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5caba378-77a0-405f-8629-067d7a9a1cd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:01.268630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5caba378-77a0-405f-8629-067d7a9a1cd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:01.269681 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5caba378-77a0-405f-8629-067d7a9a1cd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:01.271430 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5caba378-77a0-405f-8629-067d7a9a1cd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:01.272733 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5caba378-77a0-405f-8629-067d7a9a1cd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:01.385871 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2a3b5e38-8f92-4cf1-b4ca-7c8f0e9e98da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:01.389462 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2a3b5e38-8f92-4cf1-b4ca-7c8f0e9e98da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:01.428788 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2a3b5e38-8f92-4cf1-b4ca-7c8f0e9e98da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:01.429461 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2a3b5e38-8f92-4cf1-b4ca-7c8f0e9e98da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:01.430361 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2a3b5e38-8f92-4cf1-b4ca-7c8f0e9e98da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:01.433023 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2a3b5e38-8f92-4cf1-b4ca-7c8f0e9e98da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:01.603587 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2a3b5e38-8f92-4cf1-b4ca-7c8f0e9e98da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:01.622393 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2a3b5e38-8f92-4cf1-b4ca-7c8f0e9e98da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.245288 Aug 01 07:38:01.623159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 72/134] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:01 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:01.627556 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c9ecd7ac-755a-41b4-aef9-3f3ec043b362 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:01.628150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c9ecd7ac-755a-41b4-aef9-3f3ec043b362 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:01.635676 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c9ecd7ac-755a-41b4-aef9-3f3ec043b362 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:01.636116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c9ecd7ac-755a-41b4-aef9-3f3ec043b362 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:01.637173 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c9ecd7ac-755a-41b4-aef9-3f3ec043b362 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:01.637613 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c9ecd7ac-755a-41b4-aef9-3f3ec043b362 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:01.659773 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5caba378-77a0-405f-8629-067d7a9a1cd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:01.670943 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5caba378-77a0-405f-8629-067d7a9a1cd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:01.673693 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5caba378-77a0-405f-8629-067d7a9a1cd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:01.675663 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5caba378-77a0-405f-8629-067d7a9a1cd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.421088 Aug 01 07:38:01.688858 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 63/135] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:38:01 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:38:01.696513 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-32e7f02b-fc80-4c73-9549-ebada88381d5 req-d1b54cac-f397-437b-8501-b2b361908633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff143cc-5a30-44be-a327-29eaacf61348", "name": "network-vif-plugged", "status": "completed", "tag": "7b59d41d-43d0-4098-917e-f7635e0051db"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:01.707231 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-32e7f02b-fc80-4c73-9549-ebada88381d5 req-d1b54cac-f397-437b-8501-b2b361908633 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:01.708347 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-32e7f02b-fc80-4c73-9549-ebada88381d5 req-d1b54cac-f397-437b-8501-b2b361908633 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:01.724735 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-32e7f02b-fc80-4c73-9549-ebada88381d5 req-d1b54cac-f397-437b-8501-b2b361908633 service nova] Creating event network-vif-plugged:7b59d41d-43d0-4098-917e-f7635e0051db for instance 8ff143cc-5a30-44be-a327-29eaacf61348 on hv-cinder-73306 Aug 01 07:38:01.731437 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-32e7f02b-fc80-4c73-9549-ebada88381d5 req-d1b54cac-f397-437b-8501-b2b361908633 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040529 Aug 01 07:38:01.732641 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 64/136] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:38:01.740762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3735a847-1d08-4716-9cbd-75e52660e881 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:01.741482 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3735a847-1d08-4716-9cbd-75e52660e881 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:01.748387 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3735a847-1d08-4716-9cbd-75e52660e881 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:01.749331 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3735a847-1d08-4716-9cbd-75e52660e881 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:01.751135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3735a847-1d08-4716-9cbd-75e52660e881 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:01.751757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3735a847-1d08-4716-9cbd-75e52660e881 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:01.996826 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c9ecd7ac-755a-41b4-aef9-3f3ec043b362 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:02.006181 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c9ecd7ac-755a-41b4-aef9-3f3ec043b362 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.382024 Aug 01 07:38:02.007117 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 73/137] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:01 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:02.415148 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3735a847-1d08-4716-9cbd-75e52660e881 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:02.428968 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3735a847-1d08-4716-9cbd-75e52660e881 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.694127 Aug 01 07:38:02.429749 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 65/138] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:01 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:02.641962 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:02.647139 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3aa9a4ab-29f5-45a4-b33c-ab0cbd73f6b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:02.647946 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3aa9a4ab-29f5-45a4-b33c-ab0cbd73f6b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:02.654589 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3aa9a4ab-29f5-45a4-b33c-ab0cbd73f6b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:02.655240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3aa9a4ab-29f5-45a4-b33c-ab0cbd73f6b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:02.656152 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3aa9a4ab-29f5-45a4-b33c-ab0cbd73f6b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:02.656806 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3aa9a4ab-29f5-45a4-b33c-ab0cbd73f6b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:02.702023 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-41d1e2aa-ca39-44fc-91b2-fc2b485a33a1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:02.702941 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-41d1e2aa-ca39-44fc-91b2-fc2b485a33a1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:02.716341 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41d1e2aa-ca39-44fc-91b2-fc2b485a33a1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:02.721061 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41d1e2aa-ca39-44fc-91b2-fc2b485a33a1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:02.722072 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41d1e2aa-ca39-44fc-91b2-fc2b485a33a1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:02.723414 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41d1e2aa-ca39-44fc-91b2-fc2b485a33a1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:03.119683 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-41d1e2aa-ca39-44fc-91b2-fc2b485a33a1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:03.128762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-41d1e2aa-ca39-44fc-91b2-fc2b485a33a1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:03.146640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-41d1e2aa-ca39-44fc-91b2-fc2b485a33a1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:03.151649 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-41d1e2aa-ca39-44fc-91b2-fc2b485a33a1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.454572 Aug 01 07:38:03.152531 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 66/139] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:38:02 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:38:03.156839 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4415e2aa-dcd3-4a85-9f5f-93e2271a55ff tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:03.157453 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4415e2aa-dcd3-4a85-9f5f-93e2271a55ff tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:03.179788 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4415e2aa-dcd3-4a85-9f5f-93e2271a55ff tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:03.180269 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4415e2aa-dcd3-4a85-9f5f-93e2271a55ff tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:03.181695 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4415e2aa-dcd3-4a85-9f5f-93e2271a55ff tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:03.182342 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4415e2aa-dcd3-4a85-9f5f-93e2271a55ff tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:03.311353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3aa9a4ab-29f5-45a4-b33c-ab0cbd73f6b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:03.324621 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3aa9a4ab-29f5-45a4-b33c-ab0cbd73f6b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.683135 Aug 01 07:38:03.327795 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 74/140] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:02 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:03.450323 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1f959295-fa4a-4b2f-a0d8-b005d18a7d7c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:03.450992 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1f959295-fa4a-4b2f-a0d8-b005d18a7d7c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:03.465637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1f959295-fa4a-4b2f-a0d8-b005d18a7d7c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:03.466529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1f959295-fa4a-4b2f-a0d8-b005d18a7d7c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:03.466960 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1f959295-fa4a-4b2f-a0d8-b005d18a7d7c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:03.476012 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1f959295-fa4a-4b2f-a0d8-b005d18a7d7c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:03.641970 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4415e2aa-dcd3-4a85-9f5f-93e2271a55ff tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:03.655528 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4415e2aa-dcd3-4a85-9f5f-93e2271a55ff tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.502138 Aug 01 07:38:03.660696 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 67/141] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:03 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:03.866766 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-7676821d-09cc-49c5-baab-bb8334a5ffc1 req-b5105515-81ad-4cf2-b936-671711bce0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dcc6cbc-c57a-466f-b00b-f4d74fe85eda", "name": "network-vif-plugged", "status": "completed", "tag": "10a1e2ea-e7a8-494f-a680-579c506cdb2b"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:03.894301 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-7676821d-09cc-49c5-baab-bb8334a5ffc1 req-b5105515-81ad-4cf2-b936-671711bce0c1 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:03.894706 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-7676821d-09cc-49c5-baab-bb8334a5ffc1 req-b5105515-81ad-4cf2-b936-671711bce0c1 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:03.928057 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-7676821d-09cc-49c5-baab-bb8334a5ffc1 req-b5105515-81ad-4cf2-b936-671711bce0c1 service nova] Creating event network-vif-plugged:10a1e2ea-e7a8-494f-a680-579c506cdb2b for instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda on hv-cinder-73306 Aug 01 07:38:03.933142 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-7676821d-09cc-49c5-baab-bb8334a5ffc1 req-b5105515-81ad-4cf2-b936-671711bce0c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078574 Aug 01 07:38:03.933812 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 68/142] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:38:03.941331 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1f959295-fa4a-4b2f-a0d8-b005d18a7d7c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:03.958976 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1f959295-fa4a-4b2f-a0d8-b005d18a7d7c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.512640 Aug 01 07:38:03.967115 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 75/143] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:03 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:04.175370 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-eb60114f-2169-4b01-a678-67e3af37ee9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:04.176152 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-eb60114f-2169-4b01-a678-67e3af37ee9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:04.192178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eb60114f-2169-4b01-a678-67e3af37ee9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:04.194097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eb60114f-2169-4b01-a678-67e3af37ee9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:04.194954 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eb60114f-2169-4b01-a678-67e3af37ee9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:04.197139 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eb60114f-2169-4b01-a678-67e3af37ee9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:04.346058 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-10692f61-7c76-4d1c-be28-155825d567a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:04.347137 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-10692f61-7c76-4d1c-be28-155825d567a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:04.354723 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10692f61-7c76-4d1c-be28-155825d567a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:04.355615 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10692f61-7c76-4d1c-be28-155825d567a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:04.357436 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10692f61-7c76-4d1c-be28-155825d567a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:04.358488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10692f61-7c76-4d1c-be28-155825d567a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:04.506392 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-eb60114f-2169-4b01-a678-67e3af37ee9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:04.519416 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-eb60114f-2169-4b01-a678-67e3af37ee9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:04.522153 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-eb60114f-2169-4b01-a678-67e3af37ee9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:04.523584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-eb60114f-2169-4b01-a678-67e3af37ee9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1407 microversion: 2.20 time: 0.353449 Aug 01 07:38:04.524754 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 69/144] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:38:04 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:38:04.586601 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-10692f61-7c76-4d1c-be28-155825d567a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:04.609341 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-10692f61-7c76-4d1c-be28-155825d567a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.265509 Aug 01 07:38:04.625030 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 76/145] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:04 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:04.680775 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-61342c3f-817d-473e-a569-bd018e36acfc tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:04.682230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-61342c3f-817d-473e-a569-bd018e36acfc tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:04.722719 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-61342c3f-817d-473e-a569-bd018e36acfc tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:04.728393 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-61342c3f-817d-473e-a569-bd018e36acfc tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:04.731491 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-61342c3f-817d-473e-a569-bd018e36acfc tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:04.733899 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-61342c3f-817d-473e-a569-bd018e36acfc tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:05.001380 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-de69166e-2353-4521-b80d-80e16a7aeaa1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:05.002887 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-de69166e-2353-4521-b80d-80e16a7aeaa1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:05.013545 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de69166e-2353-4521-b80d-80e16a7aeaa1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:05.014002 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de69166e-2353-4521-b80d-80e16a7aeaa1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:05.014911 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de69166e-2353-4521-b80d-80e16a7aeaa1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:05.015637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de69166e-2353-4521-b80d-80e16a7aeaa1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:05.350048 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-de69166e-2353-4521-b80d-80e16a7aeaa1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:05.364631 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-de69166e-2353-4521-b80d-80e16a7aeaa1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.376829 Aug 01 07:38:05.366028 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 77/146] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:04 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:05.411619 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-61342c3f-817d-473e-a569-bd018e36acfc tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:05.432659 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-61342c3f-817d-473e-a569-bd018e36acfc tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.758608 Aug 01 07:38:05.448037 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 70/147] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:04 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:05.548108 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-10e0cd24-adc8-45cd-8f03-47c090b8b194 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:05.548806 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-10e0cd24-adc8-45cd-8f03-47c090b8b194 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:05.562076 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10e0cd24-adc8-45cd-8f03-47c090b8b194 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:05.562986 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10e0cd24-adc8-45cd-8f03-47c090b8b194 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:05.563864 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10e0cd24-adc8-45cd-8f03-47c090b8b194 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:05.564304 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10e0cd24-adc8-45cd-8f03-47c090b8b194 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:05.630489 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-77bdaa71-c19e-4579-b2ba-7aecdd0c817d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:05.631125 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-77bdaa71-c19e-4579-b2ba-7aecdd0c817d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:05.638153 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-77bdaa71-c19e-4579-b2ba-7aecdd0c817d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:05.638597 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-77bdaa71-c19e-4579-b2ba-7aecdd0c817d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:05.642605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-77bdaa71-c19e-4579-b2ba-7aecdd0c817d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:05.643098 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-77bdaa71-c19e-4579-b2ba-7aecdd0c817d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:05.810041 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-77bdaa71-c19e-4579-b2ba-7aecdd0c817d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:05.817675 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-77bdaa71-c19e-4579-b2ba-7aecdd0c817d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.191777 Aug 01 07:38:05.818957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 71/148] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:05 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:05.846416 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-10e0cd24-adc8-45cd-8f03-47c090b8b194 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:05.855456 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-10e0cd24-adc8-45cd-8f03-47c090b8b194 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:05.857023 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-10e0cd24-adc8-45cd-8f03-47c090b8b194 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:05.858260 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-10e0cd24-adc8-45cd-8f03-47c090b8b194 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1598 microversion: 2.20 time: 0.316240 Aug 01 07:38:05.861990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 78/149] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:38:05 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1598 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:38:05.883679 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-09af2409-8fe4-45ab-a7de-6a69133d2dcf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:05.883679 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-09af2409-8fe4-45ab-a7de-6a69133d2dcf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:05.889967 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-09af2409-8fe4-45ab-a7de-6a69133d2dcf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:05.890405 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-09af2409-8fe4-45ab-a7de-6a69133d2dcf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:05.891217 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-09af2409-8fe4-45ab-a7de-6a69133d2dcf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:05.891875 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-09af2409-8fe4-45ab-a7de-6a69133d2dcf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:05.971481 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-c328bb52-f64e-4661-82f1-677c69eefa30 req-3193e6a7-a5c0-4683-ad91-20a1566af7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48863078-f7de-4370-af9c-4bdba932b5c3", "name": "network-vif-plugged", "status": "completed", "tag": "e56c66fd-c11c-4962-a9be-c8b351d26751"}, {"server_uuid": "451a7361-81eb-4f1b-be18-1f144f037202", "name": "network-vif-plugged", "status": "completed", "tag": "50575a60-bea2-40e1-a490-a7dc71582936"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:05.998022 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-c328bb52-f64e-4661-82f1-677c69eefa30 req-3193e6a7-a5c0-4683-ad91-20a1566af7a4 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:05.998472 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-c328bb52-f64e-4661-82f1-677c69eefa30 req-3193e6a7-a5c0-4683-ad91-20a1566af7a4 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:06.027777 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-c328bb52-f64e-4661-82f1-677c69eefa30 req-3193e6a7-a5c0-4683-ad91-20a1566af7a4 service nova] Creating event network-vif-plugged:e56c66fd-c11c-4962-a9be-c8b351d26751 for instance 48863078-f7de-4370-af9c-4bdba932b5c3 on hv-cinder-73306 Aug 01 07:38:06.028998 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-c328bb52-f64e-4661-82f1-677c69eefa30 req-3193e6a7-a5c0-4683-ad91-20a1566af7a4 service nova] Creating event network-vif-plugged:50575a60-bea2-40e1-a490-a7dc71582936 for instance 451a7361-81eb-4f1b-be18-1f144f037202 on hv-cinder-73306 Aug 01 07:38:06.039694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-c328bb52-f64e-4661-82f1-677c69eefa30 req-3193e6a7-a5c0-4683-ad91-20a1566af7a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078738 Aug 01 07:38:06.040256 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 79/150] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:38:06.048774 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-09af2409-8fe4-45ab-a7de-6a69133d2dcf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.170682 Aug 01 07:38:06.049365 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 72/151] 10.222.0.40 () {60 vars in 1316 bytes} [Mon Aug 1 07:38:05 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:38:06.412011 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-06b46069-d637-4ba6-97fe-9e8fdf0bb822 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:06.412928 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-06b46069-d637-4ba6-97fe-9e8fdf0bb822 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:06.422514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-06b46069-d637-4ba6-97fe-9e8fdf0bb822 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:06.423178 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-06b46069-d637-4ba6-97fe-9e8fdf0bb822 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:06.424487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-06b46069-d637-4ba6-97fe-9e8fdf0bb822 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:06.425301 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-06b46069-d637-4ba6-97fe-9e8fdf0bb822 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:06.461084 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-dc00c3f3-2063-4631-af41-faf3a865783f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:06.463431 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-dc00c3f3-2063-4631-af41-faf3a865783f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:06.496796 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dc00c3f3-2063-4631-af41-faf3a865783f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:06.497704 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dc00c3f3-2063-4631-af41-faf3a865783f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:06.518239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dc00c3f3-2063-4631-af41-faf3a865783f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:06.521007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dc00c3f3-2063-4631-af41-faf3a865783f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:06.806974 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-06b46069-d637-4ba6-97fe-9e8fdf0bb822 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:06.818101 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-06b46069-d637-4ba6-97fe-9e8fdf0bb822 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.427815 Aug 01 07:38:06.822237 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 80/152] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:06 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:06.841046 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ba2e8351-f26f-4e48-b260-363d9fffbac3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:06.842594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ba2e8351-f26f-4e48-b260-363d9fffbac3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:06.854096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba2e8351-f26f-4e48-b260-363d9fffbac3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:06.855539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba2e8351-f26f-4e48-b260-363d9fffbac3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:06.856595 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba2e8351-f26f-4e48-b260-363d9fffbac3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:06.857299 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba2e8351-f26f-4e48-b260-363d9fffbac3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:07.045831 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:07.160024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ba2e8351-f26f-4e48-b260-363d9fffbac3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:07.172454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ba2e8351-f26f-4e48-b260-363d9fffbac3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.336218 Aug 01 07:38:07.184375 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-dc00c3f3-2063-4631-af41-faf3a865783f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:07.184759 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 81/153] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:06 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:07.184862 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-dc00c3f3-2063-4631-af41-faf3a865783f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1314 microversion: 2.1 time: 0.727364 Aug 01 07:38:07.187372 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 73/154] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:06 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:07.844118 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-675be5f4-b60a-4e52-8c4f-888f6f015df9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:07.844941 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-675be5f4-b60a-4e52-8c4f-888f6f015df9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:07.856954 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-675be5f4-b60a-4e52-8c4f-888f6f015df9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:07.858239 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-675be5f4-b60a-4e52-8c4f-888f6f015df9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:07.859215 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-675be5f4-b60a-4e52-8c4f-888f6f015df9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:07.859656 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-675be5f4-b60a-4e52-8c4f-888f6f015df9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:08.032638 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-675be5f4-b60a-4e52-8c4f-888f6f015df9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:08.042464 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-675be5f4-b60a-4e52-8c4f-888f6f015df9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.202724 Aug 01 07:38:08.043729 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 82/155] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:07 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:08.076431 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-521832bd-62fd-48f1-949e-e25652707d78 req-0b76a135-048f-4f1c-85e5-6ff0b427bf80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff143cc-5a30-44be-a327-29eaacf61348", "tag": "7b59d41d-43d0-4098-917e-f7635e0051db"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:08.081595 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=89 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:08.089651 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-521832bd-62fd-48f1-949e-e25652707d78 req-0b76a135-048f-4f1c-85e5-6ff0b427bf80 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:08.090509 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-521832bd-62fd-48f1-949e-e25652707d78 req-0b76a135-048f-4f1c-85e5-6ff0b427bf80 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:08.103761 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-521832bd-62fd-48f1-949e-e25652707d78 req-0b76a135-048f-4f1c-85e5-6ff0b427bf80 service nova] Creating event network-changed:7b59d41d-43d0-4098-917e-f7635e0051db for instance 8ff143cc-5a30-44be-a327-29eaacf61348 on hv-cinder-73306 Aug 01 07:38:08.110301 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-521832bd-62fd-48f1-949e-e25652707d78 req-0b76a135-048f-4f1c-85e5-6ff0b427bf80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037509 Aug 01 07:38:08.111685 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 74/156] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:38:08.196397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-fbf3a595-4b98-4502-a960-84d6ab48185f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:08.197108 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-fbf3a595-4b98-4502-a960-84d6ab48185f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:08.203237 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fbf3a595-4b98-4502-a960-84d6ab48185f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:08.203852 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fbf3a595-4b98-4502-a960-84d6ab48185f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:08.204765 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fbf3a595-4b98-4502-a960-84d6ab48185f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:08.205358 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fbf3a595-4b98-4502-a960-84d6ab48185f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:08.213264 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c7a45829-e58b-44d1-94c7-df5992e669b0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:08.214899 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c7a45829-e58b-44d1-94c7-df5992e669b0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:08.225151 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7a45829-e58b-44d1-94c7-df5992e669b0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:08.225930 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7a45829-e58b-44d1-94c7-df5992e669b0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:08.227224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7a45829-e58b-44d1-94c7-df5992e669b0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:08.227874 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7a45829-e58b-44d1-94c7-df5992e669b0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:08.233838 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:08.353529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fbf3a595-4b98-4502-a960-84d6ab48185f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:08.362250 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-fbf3a595-4b98-4502-a960-84d6ab48185f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.169615 Aug 01 07:38:08.363180 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 83/157] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:08 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:08.405366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c7a45829-e58b-44d1-94c7-df5992e669b0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:08.413700 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c7a45829-e58b-44d1-94c7-df5992e669b0 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1501 microversion: 2.1 time: 0.205387 Aug 01 07:38:08.414321 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 75/158] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:08 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:09.063582 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7be9fe5d-22e8-4821-8621-39354fc6009f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:09.064219 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7be9fe5d-22e8-4821-8621-39354fc6009f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:09.071391 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7be9fe5d-22e8-4821-8621-39354fc6009f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:09.072113 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7be9fe5d-22e8-4821-8621-39354fc6009f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:09.072892 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7be9fe5d-22e8-4821-8621-39354fc6009f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:09.073330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7be9fe5d-22e8-4821-8621-39354fc6009f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:09.241140 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7be9fe5d-22e8-4821-8621-39354fc6009f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:09.248740 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7be9fe5d-22e8-4821-8621-39354fc6009f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.189024 Aug 01 07:38:09.249319 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 84/159] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:09 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:09.386242 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-735183b0-b752-433a-a64d-a86ab7e92c2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:09.386852 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-735183b0-b752-433a-a64d-a86ab7e92c2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:09.393169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-735183b0-b752-433a-a64d-a86ab7e92c2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:09.393622 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-735183b0-b752-433a-a64d-a86ab7e92c2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:09.394394 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-735183b0-b752-433a-a64d-a86ab7e92c2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:09.395413 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-735183b0-b752-433a-a64d-a86ab7e92c2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:09.525994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-735183b0-b752-433a-a64d-a86ab7e92c2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:09.533563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-735183b0-b752-433a-a64d-a86ab7e92c2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.152113 Aug 01 07:38:09.534124 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 76/160] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:09 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:10.269938 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-40689daa-c0b3-4005-92c3-2c110206528c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:10.270534 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-40689daa-c0b3-4005-92c3-2c110206528c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:10.276574 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-40689daa-c0b3-4005-92c3-2c110206528c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:10.276961 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-40689daa-c0b3-4005-92c3-2c110206528c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:10.277753 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-40689daa-c0b3-4005-92c3-2c110206528c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:10.278132 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-40689daa-c0b3-4005-92c3-2c110206528c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:10.418763 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-40689daa-c0b3-4005-92c3-2c110206528c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:10.431268 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-40689daa-c0b3-4005-92c3-2c110206528c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1364 microversion: 2.1 time: 0.165276 Aug 01 07:38:10.439789 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 85/161] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:10 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:10.554322 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fe776865-89e4-4d0b-85f8-79672413d5a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:10.554926 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fe776865-89e4-4d0b-85f8-79672413d5a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:10.561236 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe776865-89e4-4d0b-85f8-79672413d5a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:10.561687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe776865-89e4-4d0b-85f8-79672413d5a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:10.562445 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe776865-89e4-4d0b-85f8-79672413d5a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:10.562883 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe776865-89e4-4d0b-85f8-79672413d5a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:10.705010 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fe776865-89e4-4d0b-85f8-79672413d5a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:10.718979 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fe776865-89e4-4d0b-85f8-79672413d5a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.168981 Aug 01 07:38:10.734896 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 77/162] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:10 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:10.875927 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d9c256fc-c8a3-4cb8-af03-ab2cec1664e5 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83e2ff25-0ccf-4bb4-b755-c0149a693aa1"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:10.878266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d9c256fc-c8a3-4cb8-af03-ab2cec1664e5 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:10.885013 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d9c256fc-c8a3-4cb8-af03-ab2cec1664e5 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:10.885444 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d9c256fc-c8a3-4cb8-af03-ab2cec1664e5 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:10.886191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d9c256fc-c8a3-4cb8-af03-ab2cec1664e5 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:10.886628 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d9c256fc-c8a3-4cb8-af03-ab2cec1664e5 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:11.453122 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5bac88de-79dd-425f-a6bd-7e836dac4f6a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:11.453916 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5bac88de-79dd-425f-a6bd-7e836dac4f6a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:11.461591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5bac88de-79dd-425f-a6bd-7e836dac4f6a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:11.462041 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5bac88de-79dd-425f-a6bd-7e836dac4f6a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:11.462795 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5bac88de-79dd-425f-a6bd-7e836dac4f6a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:11.463272 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5bac88de-79dd-425f-a6bd-7e836dac4f6a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:11.594656 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5bac88de-79dd-425f-a6bd-7e836dac4f6a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:11.602666 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5bac88de-79dd-425f-a6bd-7e836dac4f6a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1550 microversion: 2.1 time: 0.153336 Aug 01 07:38:11.603318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 78/163] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:11 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:11.623558 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6e959256-208a-41eb-bd1a-855ded144f13 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:11.624066 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6e959256-208a-41eb-bd1a-855ded144f13 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:11.630857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6e959256-208a-41eb-bd1a-855ded144f13 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:11.631336 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6e959256-208a-41eb-bd1a-855ded144f13 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:11.632104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6e959256-208a-41eb-bd1a-855ded144f13 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:11.632545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6e959256-208a-41eb-bd1a-855ded144f13 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:11.715024 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6e959256-208a-41eb-bd1a-855ded144f13 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095258 Aug 01 07:38:11.715799 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 79/164] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 1 07:38:11 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:38:11.741925 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-28072323-b546-45a2-8e65-915ce3f21fdf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:11.742520 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-28072323-b546-45a2-8e65-915ce3f21fdf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:11.748905 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-28072323-b546-45a2-8e65-915ce3f21fdf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:11.749352 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-28072323-b546-45a2-8e65-915ce3f21fdf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:11.750101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-28072323-b546-45a2-8e65-915ce3f21fdf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:11.750528 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-28072323-b546-45a2-8e65-915ce3f21fdf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:12.010351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-28072323-b546-45a2-8e65-915ce3f21fdf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:12.019925 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-28072323-b546-45a2-8e65-915ce3f21fdf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.281530 Aug 01 07:38:12.020839 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 80/165] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:11 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:12.951232 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-3360c53b-cfc3-4c70-81fd-64fe83cf1507 req-79afeb5c-2c5d-4acf-b0ac-1c523aab9425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48863078-f7de-4370-af9c-4bdba932b5c3", "tag": "e56c66fd-c11c-4962-a9be-c8b351d26751"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:12.965383 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-3360c53b-cfc3-4c70-81fd-64fe83cf1507 req-79afeb5c-2c5d-4acf-b0ac-1c523aab9425 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:12.965383 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-3360c53b-cfc3-4c70-81fd-64fe83cf1507 req-79afeb5c-2c5d-4acf-b0ac-1c523aab9425 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:12.977113 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-3360c53b-cfc3-4c70-81fd-64fe83cf1507 req-79afeb5c-2c5d-4acf-b0ac-1c523aab9425 service nova] Creating event network-changed:e56c66fd-c11c-4962-a9be-c8b351d26751 for instance 48863078-f7de-4370-af9c-4bdba932b5c3 on hv-cinder-73306 Aug 01 07:38:12.981946 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-3360c53b-cfc3-4c70-81fd-64fe83cf1507 req-79afeb5c-2c5d-4acf-b0ac-1c523aab9425 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034377 Aug 01 07:38:12.982547 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 81/166] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:38:13.041778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ad293ee6-8d9a-449e-a65f-33fd73c5783b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:13.042464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ad293ee6-8d9a-449e-a65f-33fd73c5783b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:13.048672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad293ee6-8d9a-449e-a65f-33fd73c5783b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:13.049124 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad293ee6-8d9a-449e-a65f-33fd73c5783b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:13.049889 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad293ee6-8d9a-449e-a65f-33fd73c5783b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:13.050328 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad293ee6-8d9a-449e-a65f-33fd73c5783b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:13.187490 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ad293ee6-8d9a-449e-a65f-33fd73c5783b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:13.200282 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ad293ee6-8d9a-449e-a65f-33fd73c5783b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.162598 Aug 01 07:38:13.207466 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 82/167] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:13 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:14.221450 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9a2a32bc-4e9b-4960-bdf9-7bb9429f4120 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:14.221999 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9a2a32bc-4e9b-4960-bdf9-7bb9429f4120 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:14.228555 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9a2a32bc-4e9b-4960-bdf9-7bb9429f4120 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:14.229001 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9a2a32bc-4e9b-4960-bdf9-7bb9429f4120 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:14.229751 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9a2a32bc-4e9b-4960-bdf9-7bb9429f4120 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:14.230179 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9a2a32bc-4e9b-4960-bdf9-7bb9429f4120 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:14.360888 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9a2a32bc-4e9b-4960-bdf9-7bb9429f4120 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:14.369621 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9a2a32bc-4e9b-4960-bdf9-7bb9429f4120 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1322 microversion: 2.1 time: 0.151968 Aug 01 07:38:14.370186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 83/168] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:14 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:14.847307 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:14.859410 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d9c256fc-c8a3-4cb8-af03-ab2cec1664e5 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "POST /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.987134 Aug 01 07:38:14.860313 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 86/169] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:38:10 2022] POST /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda/os-volume_attachments => generated 194 bytes in 3989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:38:15.397871 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d26e64a9-89df-4564-a4f5-a71f55074972 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:15.398600 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d26e64a9-89df-4564-a4f5-a71f55074972 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:15.405061 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d26e64a9-89df-4564-a4f5-a71f55074972 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:15.405735 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d26e64a9-89df-4564-a4f5-a71f55074972 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:15.406707 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d26e64a9-89df-4564-a4f5-a71f55074972 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:15.407346 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d26e64a9-89df-4564-a4f5-a71f55074972 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:15.568566 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d26e64a9-89df-4564-a4f5-a71f55074972 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:15.577161 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d26e64a9-89df-4564-a4f5-a71f55074972 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1515 microversion: 2.1 time: 0.183563 Aug 01 07:38:15.578151 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 84/170] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:15 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:15.604208 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-be2bed3e-3412-40e9-ac7b-33076e6538c3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:15.606643 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-be2bed3e-3412-40e9-ac7b-33076e6538c3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:15.614447 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=89 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:15.618214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-be2bed3e-3412-40e9-ac7b-33076e6538c3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:15.618685 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-be2bed3e-3412-40e9-ac7b-33076e6538c3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:15.621446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-be2bed3e-3412-40e9-ac7b-33076e6538c3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:15.622029 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-be2bed3e-3412-40e9-ac7b-33076e6538c3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:15.649802 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-be2bed3e-3412-40e9-ac7b-33076e6538c3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lazy-loading 'flavor' on Instance uuid 451a7361-81eb-4f1b-be18-1f144f037202 {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:38:15.866525 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-be2bed3e-3412-40e9-ac7b-33076e6538c3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202/action" status: 200 len: 32 microversion: 2.1 time: 0.269631 Aug 01 07:38:15.867282 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 87/171] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:38:15 2022] POST /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202/action => generated 32 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 07:38:15.878364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4837167e-a08f-4372-ac20-3b46f5c29e28 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:15.880408 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4837167e-a08f-4372-ac20-3b46f5c29e28 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:15.889816 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4837167e-a08f-4372-ac20-3b46f5c29e28 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:15.891246 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4837167e-a08f-4372-ac20-3b46f5c29e28 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:15.893133 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4837167e-a08f-4372-ac20-3b46f5c29e28 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:15.893832 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4837167e-a08f-4372-ac20-3b46f5c29e28 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:16.071545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4837167e-a08f-4372-ac20-3b46f5c29e28 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:16.079350 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4837167e-a08f-4372-ac20-3b46f5c29e28 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.205951 Aug 01 07:38:16.091290 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 85/172] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:15 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:17.102488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-494d1892-d595-445a-b824-9b9f8a7e010a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:17.103129 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-494d1892-d595-445a-b824-9b9f8a7e010a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:17.110064 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-494d1892-d595-445a-b824-9b9f8a7e010a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:17.110580 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-494d1892-d595-445a-b824-9b9f8a7e010a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:17.111697 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-494d1892-d595-445a-b824-9b9f8a7e010a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:17.112436 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-494d1892-d595-445a-b824-9b9f8a7e010a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:17.279855 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-494d1892-d595-445a-b824-9b9f8a7e010a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:17.288536 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-494d1892-d595-445a-b824-9b9f8a7e010a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.191425 Aug 01 07:38:17.289301 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 88/173] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:17 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:18.309344 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7cb075d2-29ba-472c-92bc-b0b0b1b89626 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:18.310159 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7cb075d2-29ba-472c-92bc-b0b0b1b89626 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:18.316432 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7cb075d2-29ba-472c-92bc-b0b0b1b89626 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:18.317008 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7cb075d2-29ba-472c-92bc-b0b0b1b89626 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:18.317862 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7cb075d2-29ba-472c-92bc-b0b0b1b89626 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:18.318408 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7cb075d2-29ba-472c-92bc-b0b0b1b89626 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:18.473412 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7cb075d2-29ba-472c-92bc-b0b0b1b89626 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:18.481112 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7cb075d2-29ba-472c-92bc-b0b0b1b89626 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.175663 Aug 01 07:38:18.481679 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 86/174] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:18 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:19.505914 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-584cf2ed-0bde-492b-b7ee-6df78be7dd5b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:19.507734 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-584cf2ed-0bde-492b-b7ee-6df78be7dd5b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:19.517458 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-584cf2ed-0bde-492b-b7ee-6df78be7dd5b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:19.518425 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-584cf2ed-0bde-492b-b7ee-6df78be7dd5b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:19.520672 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-584cf2ed-0bde-492b-b7ee-6df78be7dd5b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:19.521324 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-584cf2ed-0bde-492b-b7ee-6df78be7dd5b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:19.679612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-584cf2ed-0bde-492b-b7ee-6df78be7dd5b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:19.687953 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-584cf2ed-0bde-492b-b7ee-6df78be7dd5b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.188657 Aug 01 07:38:19.688313 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 89/175] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:19 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:20.713141 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1f2594df-d1e2-4e0d-9b7b-ed43ae781141 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:20.713831 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1f2594df-d1e2-4e0d-9b7b-ed43ae781141 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:20.720180 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1f2594df-d1e2-4e0d-9b7b-ed43ae781141 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:20.720669 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1f2594df-d1e2-4e0d-9b7b-ed43ae781141 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:20.721558 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1f2594df-d1e2-4e0d-9b7b-ed43ae781141 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:20.722038 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1f2594df-d1e2-4e0d-9b7b-ed43ae781141 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:20.932031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1f2594df-d1e2-4e0d-9b7b-ed43ae781141 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:20.959322 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1f2594df-d1e2-4e0d-9b7b-ed43ae781141 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.249988 Aug 01 07:38:20.960345 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 87/176] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:20 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:21.986666 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-12d0ba0e-e3ad-402f-bc95-db8763a6cede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:21.987410 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-12d0ba0e-e3ad-402f-bc95-db8763a6cede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:21.994862 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-12d0ba0e-e3ad-402f-bc95-db8763a6cede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:21.995561 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-12d0ba0e-e3ad-402f-bc95-db8763a6cede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:21.996536 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-12d0ba0e-e3ad-402f-bc95-db8763a6cede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:21.997016 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-12d0ba0e-e3ad-402f-bc95-db8763a6cede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:22.142708 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-12d0ba0e-e3ad-402f-bc95-db8763a6cede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:22.150446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-12d0ba0e-e3ad-402f-bc95-db8763a6cede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.168205 Aug 01 07:38:22.151113 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 90/177] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:21 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:23.172449 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9636a348-964b-4b44-b0dd-1ee4de97e434 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:23.173052 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9636a348-964b-4b44-b0dd-1ee4de97e434 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:23.180058 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9636a348-964b-4b44-b0dd-1ee4de97e434 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:23.181356 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9636a348-964b-4b44-b0dd-1ee4de97e434 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:23.182167 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9636a348-964b-4b44-b0dd-1ee4de97e434 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:23.182788 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9636a348-964b-4b44-b0dd-1ee4de97e434 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:23.414124 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9636a348-964b-4b44-b0dd-1ee4de97e434 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:23.423932 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9636a348-964b-4b44-b0dd-1ee4de97e434 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.254884 Aug 01 07:38:23.424614 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 88/178] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:23 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:24.444961 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-67c6a3bd-dd5e-4856-90dd-2c544e65bad8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:24.445494 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-67c6a3bd-dd5e-4856-90dd-2c544e65bad8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:24.452373 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-67c6a3bd-dd5e-4856-90dd-2c544e65bad8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:24.452816 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-67c6a3bd-dd5e-4856-90dd-2c544e65bad8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:24.453562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-67c6a3bd-dd5e-4856-90dd-2c544e65bad8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:24.453991 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-67c6a3bd-dd5e-4856-90dd-2c544e65bad8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:24.587277 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-67c6a3bd-dd5e-4856-90dd-2c544e65bad8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:24.594808 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-67c6a3bd-dd5e-4856-90dd-2c544e65bad8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.153873 Aug 01 07:38:24.595355 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 91/179] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:24 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:25.616720 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-07ab185d-f63a-4e26-856e-3c690f82e93e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:25.617324 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-07ab185d-f63a-4e26-856e-3c690f82e93e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:25.623348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-07ab185d-f63a-4e26-856e-3c690f82e93e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:25.623820 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-07ab185d-f63a-4e26-856e-3c690f82e93e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:25.624564 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-07ab185d-f63a-4e26-856e-3c690f82e93e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:25.625002 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-07ab185d-f63a-4e26-856e-3c690f82e93e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:25.757965 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-07ab185d-f63a-4e26-856e-3c690f82e93e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:25.765286 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-07ab185d-f63a-4e26-856e-3c690f82e93e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.153666 Aug 01 07:38:25.765840 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 89/180] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:25 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:26.396865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1031039144", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "networks": [{"uuid": "8898159d-f24d-4cd2-9340-d84903b2bbea"}]}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:26.450422 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.network.neutron [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] validate_networks() for [('8898159d-f24d-4cd2-9340-d84903b2bbea', None, None, None, None, None)] {{(pid=124279) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:38:26.786224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2949b420-bc4d-42a3-ae78-4c7bbf5ddd82 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:26.786915 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2949b420-bc4d-42a3-ae78-4c7bbf5ddd82 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:26.793007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2949b420-bc4d-42a3-ae78-4c7bbf5ddd82 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:26.793467 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2949b420-bc4d-42a3-ae78-4c7bbf5ddd82 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:26.794238 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2949b420-bc4d-42a3-ae78-4c7bbf5ddd82 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:26.794679 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2949b420-bc4d-42a3-ae78-4c7bbf5ddd82 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:26.811694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Flavor limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:38:26.812813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Image limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:38:26.812813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Flavor pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:38:26.813160 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Image pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:38:26.813571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:38:26.824107 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:26.824553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:26.825581 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:26.826071 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:26.842922 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Getting quotas for project a5b0cb87dfc4461e9911c7e62b6ab959. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:38:26.847412 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Getting quotas for user 9255edea8b504727a587443e124f3e7a and project a5b0cb87dfc4461e9911c7e62b6ab959. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:38:26.858665 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Going to run 1 instances... {{(pid=124279) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:38:26.861022 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:38:26.929273 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-84a25771-bced-4a7f-9adc-71920bb47176 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536587 Aug 01 07:38:26.929538 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 92/181] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:38:26.944159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-cb208cb4-b61d-4900-8c75-ffa0680309da tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:26.948659 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-cb208cb4-b61d-4900-8c75-ffa0680309da tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:26.953060 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2949b420-bc4d-42a3-ae78-4c7bbf5ddd82 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:26.962830 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2949b420-bc4d-42a3-ae78-4c7bbf5ddd82 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.180886 Aug 01 07:38:26.963851 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 90/182] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:26 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:27.034376 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-cb208cb4-b61d-4900-8c75-ffa0680309da tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:27.042171 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-cb208cb4-b61d-4900-8c75-ffa0680309da tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1214 microversion: 2.1 time: 0.104717 Aug 01 07:38:27.043311 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 93/183] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:26 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:27.988530 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-66b17326-3a89-4c8f-b032-373549f9ad85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:27.989469 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-66b17326-3a89-4c8f-b032-373549f9ad85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:27.997372 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-66b17326-3a89-4c8f-b032-373549f9ad85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:27.998133 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-66b17326-3a89-4c8f-b032-373549f9ad85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:27.999578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-66b17326-3a89-4c8f-b032-373549f9ad85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:28.000110 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-66b17326-3a89-4c8f-b032-373549f9ad85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:28.064183 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0a2f1e48-2c73-4c85-a40c-5ba9511890d6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:28.065397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0a2f1e48-2c73-4c85-a40c-5ba9511890d6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:28.072821 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0a2f1e48-2c73-4c85-a40c-5ba9511890d6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:28.073380 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0a2f1e48-2c73-4c85-a40c-5ba9511890d6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:28.074218 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0a2f1e48-2c73-4c85-a40c-5ba9511890d6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:28.074721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0a2f1e48-2c73-4c85-a40c-5ba9511890d6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:28.138010 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0a2f1e48-2c73-4c85-a40c-5ba9511890d6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:28.146405 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0a2f1e48-2c73-4c85-a40c-5ba9511890d6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1266 microversion: 2.1 time: 0.086046 Aug 01 07:38:28.161448 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 94/184] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:28 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:28.193461 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-66b17326-3a89-4c8f-b032-373549f9ad85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:28.201068 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-66b17326-3a89-4c8f-b032-373549f9ad85 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.217772 Aug 01 07:38:28.201647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 91/185] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:27 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:28.926626 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d78cc98c-99cc-42b6-9618-3f02445572fb tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:28.927420 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d78cc98c-99cc-42b6-9618-3f02445572fb tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:28.933494 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d78cc98c-99cc-42b6-9618-3f02445572fb tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:28.934211 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d78cc98c-99cc-42b6-9618-3f02445572fb tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:28.935238 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d78cc98c-99cc-42b6-9618-3f02445572fb tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:28.935750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d78cc98c-99cc-42b6-9618-3f02445572fb tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:28.978612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d78cc98c-99cc-42b6-9618-3f02445572fb tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:38:29.106727 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d78cc98c-99cc-42b6-9618-3f02445572fb tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 204 len: 0 microversion: 2.1 time: 0.184441 Aug 01 07:38:29.111116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 95/186] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:38:28 2022] DELETE /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:38:29.118389 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4af6f991-b85a-4acd-ac60-59a83b42309e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:29.122882 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4af6f991-b85a-4acd-ac60-59a83b42309e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:29.138805 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4af6f991-b85a-4acd-ac60-59a83b42309e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:29.141630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4af6f991-b85a-4acd-ac60-59a83b42309e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:29.144466 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4af6f991-b85a-4acd-ac60-59a83b42309e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:29.145033 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4af6f991-b85a-4acd-ac60-59a83b42309e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:29.170689 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9f635d35-2122-48fa-b2f2-53f2636475c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:29.171747 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9f635d35-2122-48fa-b2f2-53f2636475c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:29.183620 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9f635d35-2122-48fa-b2f2-53f2636475c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:29.184093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9f635d35-2122-48fa-b2f2-53f2636475c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:29.184878 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9f635d35-2122-48fa-b2f2-53f2636475c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:29.185320 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9f635d35-2122-48fa-b2f2-53f2636475c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:29.264865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9f635d35-2122-48fa-b2f2-53f2636475c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:29.275608 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9f635d35-2122-48fa-b2f2-53f2636475c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1272 microversion: 2.1 time: 0.110059 Aug 01 07:38:29.277210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 96/187] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:29 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:29.282143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3519077b-d826-44c9-a1dd-3e1737120b99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:29.282748 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3519077b-d826-44c9-a1dd-3e1737120b99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:29.289956 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3519077b-d826-44c9-a1dd-3e1737120b99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:29.290417 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3519077b-d826-44c9-a1dd-3e1737120b99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:29.291366 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3519077b-d826-44c9-a1dd-3e1737120b99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:29.291811 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3519077b-d826-44c9-a1dd-3e1737120b99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:29.443217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3519077b-d826-44c9-a1dd-3e1737120b99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:29.452828 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3519077b-d826-44c9-a1dd-3e1737120b99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.174573 Aug 01 07:38:29.453568 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 97/188] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:29 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:29.469841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4af6f991-b85a-4acd-ac60-59a83b42309e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:29.477290 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:29.481629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4af6f991-b85a-4acd-ac60-59a83b42309e tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1553 microversion: 2.1 time: 0.367857 Aug 01 07:38:29.482282 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 92/189] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:29 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1553 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:30.298158 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6efbd195-e3fe-4ebb-b17e-32aaa55bd576 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:30.299146 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6efbd195-e3fe-4ebb-b17e-32aaa55bd576 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:30.306132 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6efbd195-e3fe-4ebb-b17e-32aaa55bd576 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:30.306659 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6efbd195-e3fe-4ebb-b17e-32aaa55bd576 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:30.307473 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6efbd195-e3fe-4ebb-b17e-32aaa55bd576 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:30.307928 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6efbd195-e3fe-4ebb-b17e-32aaa55bd576 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:30.443229 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6efbd195-e3fe-4ebb-b17e-32aaa55bd576 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:30.450805 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6efbd195-e3fe-4ebb-b17e-32aaa55bd576 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1314 microversion: 2.1 time: 0.156903 Aug 01 07:38:30.451401 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 98/190] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:30 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:30.475276 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-51a0ebc5-5654-4584-9766-d0c60d4d758a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:30.475987 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-51a0ebc5-5654-4584-9766-d0c60d4d758a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:30.483463 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-51a0ebc5-5654-4584-9766-d0c60d4d758a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:30.483994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-51a0ebc5-5654-4584-9766-d0c60d4d758a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:30.484834 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-51a0ebc5-5654-4584-9766-d0c60d4d758a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:30.485275 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-51a0ebc5-5654-4584-9766-d0c60d4d758a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:30.507174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-56f87c7f-962f-4e94-a968-25d5bf3c8b18 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:30.507874 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-56f87c7f-962f-4e94-a968-25d5bf3c8b18 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:30.514499 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-56f87c7f-962f-4e94-a968-25d5bf3c8b18 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:30.515130 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-56f87c7f-962f-4e94-a968-25d5bf3c8b18 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:30.516078 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-56f87c7f-962f-4e94-a968-25d5bf3c8b18 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:30.516558 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-56f87c7f-962f-4e94-a968-25d5bf3c8b18 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:30.668280 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-51a0ebc5-5654-4584-9766-d0c60d4d758a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:30.677357 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-51a0ebc5-5654-4584-9766-d0c60d4d758a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.207372 Aug 01 07:38:30.678187 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 93/191] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:30 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:30.692408 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-56f87c7f-962f-4e94-a968-25d5bf3c8b18 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:30.700406 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-56f87c7f-962f-4e94-a968-25d5bf3c8b18 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1553 microversion: 2.1 time: 0.197804 Aug 01 07:38:30.700981 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 99/192] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:30 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:31.476160 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8301fdd6-beff-4bca-b909-c130605b65d4 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:31.477124 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8301fdd6-beff-4bca-b909-c130605b65d4 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:31.483136 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8301fdd6-beff-4bca-b909-c130605b65d4 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:31.483584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8301fdd6-beff-4bca-b909-c130605b65d4 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:31.484359 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8301fdd6-beff-4bca-b909-c130605b65d4 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:31.484795 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8301fdd6-beff-4bca-b909-c130605b65d4 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:31.541247 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-4cd41378-0b3b-4c1a-9167-c510819dcdcf req-87bbfa4e-9c9f-4cef-9cc3-5dcb55c2a996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e9f6006-ddb1-47ab-9290-c76a0e29f39b", "tag": "b5c0c1d8-297b-4406-96ab-a075eae66486"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:31.555493 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-4cd41378-0b3b-4c1a-9167-c510819dcdcf req-87bbfa4e-9c9f-4cef-9cc3-5dcb55c2a996 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:31.556266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-4cd41378-0b3b-4c1a-9167-c510819dcdcf req-87bbfa4e-9c9f-4cef-9cc3-5dcb55c2a996 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:31.580872 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-4cd41378-0b3b-4c1a-9167-c510819dcdcf req-87bbfa4e-9c9f-4cef-9cc3-5dcb55c2a996 service nova] Creating event network-changed:b5c0c1d8-297b-4406-96ab-a075eae66486 for instance 0e9f6006-ddb1-47ab-9290-c76a0e29f39b on hv-cinder-73306 Aug 01 07:38:31.587180 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-4cd41378-0b3b-4c1a-9167-c510819dcdcf req-87bbfa4e-9c9f-4cef-9cc3-5dcb55c2a996 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051231 Aug 01 07:38:31.588943 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 100/193] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:38:31.700207 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2ee2eb41-9a85-4449-8a96-10ae7c6b8005 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:31.701263 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2ee2eb41-9a85-4449-8a96-10ae7c6b8005 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:31.711373 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2ee2eb41-9a85-4449-8a96-10ae7c6b8005 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:31.712251 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2ee2eb41-9a85-4449-8a96-10ae7c6b8005 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:31.713768 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2ee2eb41-9a85-4449-8a96-10ae7c6b8005 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:31.714302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2ee2eb41-9a85-4449-8a96-10ae7c6b8005 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:31.976630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8301fdd6-beff-4bca-b909-c130605b65d4 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:31.986912 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8301fdd6-beff-4bca-b909-c130605b65d4 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1314 microversion: 2.1 time: 0.515498 Aug 01 07:38:31.993957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 94/194] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:31 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:32.001837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-35866a40-b5fe-4859-b731-4e5af943c2e1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:32.002473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-35866a40-b5fe-4859-b731-4e5af943c2e1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:32.010272 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35866a40-b5fe-4859-b731-4e5af943c2e1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:32.010942 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35866a40-b5fe-4859-b731-4e5af943c2e1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:32.011929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35866a40-b5fe-4859-b731-4e5af943c2e1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:32.012373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35866a40-b5fe-4859-b731-4e5af943c2e1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:32.124114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2ee2eb41-9a85-4449-8a96-10ae7c6b8005 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:32.134309 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2ee2eb41-9a85-4449-8a96-10ae7c6b8005 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.438186 Aug 01 07:38:32.135331 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 101/195] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:31 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:32.354334 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-35866a40-b5fe-4859-b731-4e5af943c2e1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:32.366315 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-35866a40-b5fe-4859-b731-4e5af943c2e1 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1553 microversion: 2.1 time: 0.370333 Aug 01 07:38:32.366908 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 95/196] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:31 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1553 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:33.008258 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5ffdf302-cf8f-4c9a-9d6f-54d926b1ed45 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:33.009056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5ffdf302-cf8f-4c9a-9d6f-54d926b1ed45 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:33.017052 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ffdf302-cf8f-4c9a-9d6f-54d926b1ed45 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:33.018189 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ffdf302-cf8f-4c9a-9d6f-54d926b1ed45 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:33.020060 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ffdf302-cf8f-4c9a-9d6f-54d926b1ed45 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:33.021510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ffdf302-cf8f-4c9a-9d6f-54d926b1ed45 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:33.029457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:33.155056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2a477d71-e14a-4b02-a9d2-d5db3a24e3a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:33.156370 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2a477d71-e14a-4b02-a9d2-d5db3a24e3a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:33.162961 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2a477d71-e14a-4b02-a9d2-d5db3a24e3a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:33.163755 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2a477d71-e14a-4b02-a9d2-d5db3a24e3a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:33.164938 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2a477d71-e14a-4b02-a9d2-d5db3a24e3a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:33.165526 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2a477d71-e14a-4b02-a9d2-d5db3a24e3a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:33.320601 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5ffdf302-cf8f-4c9a-9d6f-54d926b1ed45 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:33.343114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5ffdf302-cf8f-4c9a-9d6f-54d926b1ed45 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1314 microversion: 2.1 time: 0.339110 Aug 01 07:38:33.350483 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 102/197] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:33 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:33.371241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2a477d71-e14a-4b02-a9d2-d5db3a24e3a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:33.385465 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2a477d71-e14a-4b02-a9d2-d5db3a24e3a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.234035 Aug 01 07:38:33.386690 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 96/198] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:33 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:33.391114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1118e18e-5f1d-4d53-acbb-973bf2bb2b0f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:33.391767 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1118e18e-5f1d-4d53-acbb-973bf2bb2b0f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:33.405076 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1118e18e-5f1d-4d53-acbb-973bf2bb2b0f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:33.405543 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1118e18e-5f1d-4d53-acbb-973bf2bb2b0f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:33.408476 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1118e18e-5f1d-4d53-acbb-973bf2bb2b0f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:33.408931 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1118e18e-5f1d-4d53-acbb-973bf2bb2b0f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:33.510318 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1118e18e-5f1d-4d53-acbb-973bf2bb2b0f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '905e317fcf49428ea1fa708dfabc958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bab4dbf0c34ae0be1be397427c99e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:33.525431 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1118e18e-5f1d-4d53-acbb-973bf2bb2b0f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 200 len: 1511 microversion: 2.1 time: 0.140662 Aug 01 07:38:33.526171 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 103/199] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:33 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 1511 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:33.657267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-dabbbb15-41f9-4a98-a5a2-61547acd21df req-319dfecf-92c1-4050-b59a-17a602868522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dcc6cbc-c57a-466f-b00b-f4d74fe85eda", "name": "network-vif-deleted", "tag": "10a1e2ea-e7a8-494f-a680-579c506cdb2b"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:33.669836 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-dabbbb15-41f9-4a98-a5a2-61547acd21df req-319dfecf-92c1-4050-b59a-17a602868522 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:33.670673 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-dabbbb15-41f9-4a98-a5a2-61547acd21df req-319dfecf-92c1-4050-b59a-17a602868522 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:33.686145 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-dabbbb15-41f9-4a98-a5a2-61547acd21df req-319dfecf-92c1-4050-b59a-17a602868522 service nova] Creating event network-vif-deleted:10a1e2ea-e7a8-494f-a680-579c506cdb2b for instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda on hv-cinder-73306 Aug 01 07:38:33.696648 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-dabbbb15-41f9-4a98-a5a2-61547acd21df req-319dfecf-92c1-4050-b59a-17a602868522 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048169 Aug 01 07:38:33.697383 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 97/200] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:38:34.373443 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e4e8f83b-18fc-47c1-898c-a96d1d269310 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:34.374205 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e4e8f83b-18fc-47c1-898c-a96d1d269310 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:34.383685 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e4e8f83b-18fc-47c1-898c-a96d1d269310 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:34.384296 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e4e8f83b-18fc-47c1-898c-a96d1d269310 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:34.385744 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e4e8f83b-18fc-47c1-898c-a96d1d269310 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:34.386408 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e4e8f83b-18fc-47c1-898c-a96d1d269310 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:34.417705 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e6d01b18-159b-470a-9a41-339f05363e3a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:34.425491 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e6d01b18-159b-470a-9a41-339f05363e3a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:34.445808 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e6d01b18-159b-470a-9a41-339f05363e3a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:34.446430 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e6d01b18-159b-470a-9a41-339f05363e3a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:34.448208 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e6d01b18-159b-470a-9a41-339f05363e3a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:34.450828 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e6d01b18-159b-470a-9a41-339f05363e3a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:34.647326 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e6d01b18-159b-470a-9a41-339f05363e3a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:34.656270 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e6d01b18-159b-470a-9a41-339f05363e3a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.246504 Aug 01 07:38:34.659869 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 98/201] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:34 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:34.664073 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cafadd3c-98ae-4e2a-bd77-8167cd09c8e7 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:34.664983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-cafadd3c-98ae-4e2a-bd77-8167cd09c8e7 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:34.671675 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cafadd3c-98ae-4e2a-bd77-8167cd09c8e7 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:34.681320 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e4e8f83b-18fc-47c1-898c-a96d1d269310 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:34.692611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cafadd3c-98ae-4e2a-bd77-8167cd09c8e7 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:34.694594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e4e8f83b-18fc-47c1-898c-a96d1d269310 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1314 microversion: 2.1 time: 0.326478 Aug 01 07:38:34.707908 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cafadd3c-98ae-4e2a-bd77-8167cd09c8e7 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:34.708545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cafadd3c-98ae-4e2a-bd77-8167cd09c8e7 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:34.713206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 104/202] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:34 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:34.729923 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-cafadd3c-98ae-4e2a-bd77-8167cd09c8e7 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] HTTP exception thrown: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cafadd3c-98ae-4e2a-bd77-8167cd09c8e7 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Request method failure captured: Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda HTTP/1.1 Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KzKT2mmHmAyoZZLVJGiH9GKkcIO0EPnCiudgTJ-lqMg2sao54jlfkU29uu0KsFoov8p_y1PGQAJISGztusdfeqeJcNaB3Hd7CSnlyeRpC_dtcmfawd9npnHgMgCjWqBAfVAQmtuW_3YbXxVfclwQ4GABHBvmf566Fs9zSMlvNNihs Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 53bab4dbf0c34ae0be1be397427c99e8 Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:38:34.734791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 53bab4dbf0c34ae0be1be397427c99e8 Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-DeleteServersTestJSON-1761947773-project Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 905e317fcf49428ea1fa708dfabc958e Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-DeleteServersTestJSON-1761947773-project Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:34.736397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '5dcc6cbc-c57a-466f-b00b-f4d74fe85eda'} Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:38:34.737827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:34.739687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:34.741707 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cafadd3c-98ae-4e2a-bd77-8167cd09c8e7 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Returning 404 to user: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:38:34.742722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-cafadd3c-98ae-4e2a-bd77-8167cd09c8e7 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 404 len: 111 microversion: 2.1 time: 0.084595 Aug 01 07:38:34.743467 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 99/203] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:34 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:38:34.903226 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9756f09b-23dc-4b65-96ab-822ebd9465e8 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:34.905644 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9756f09b-23dc-4b65-96ab-822ebd9465e8 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:34.915868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9756f09b-23dc-4b65-96ab-822ebd9465e8 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:34.916322 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9756f09b-23dc-4b65-96ab-822ebd9465e8 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:34.917103 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9756f09b-23dc-4b65-96ab-822ebd9465e8 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:34.917539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9756f09b-23dc-4b65-96ab-822ebd9465e8 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:34.955360 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-9756f09b-23dc-4b65-96ab-822ebd9465e8 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] HTTP exception thrown: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9756f09b-23dc-4b65-96ab-822ebd9465e8 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Request method failure captured: Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda/os-volume_attachments HTTP/1.1 Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54KzKT2mmHmAyoZZLVJGiH9GKkcIO0EPnCiudgTJ-lqMg2sao54jlfkU29uu0KsFoov8p_y1PGQAJISGztusdfeqeJcNaB3Hd7CSnlyeRpC_dtcmfawd9npnHgMgCjWqBAfVAQmtuW_3YbXxVfclwQ4GABHBvmf566Fs9zSMlvNNihs Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 53bab4dbf0c34ae0be1be397427c99e8 Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:38:34.975917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 53bab4dbf0c34ae0be1be397427c99e8 Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-DeleteServersTestJSON-1761947773-project Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 905e317fcf49428ea1fa708dfabc958e Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-DeleteServersTestJSON-1761947773-project Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:34.977451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'server_id': '5dcc6cbc-c57a-466f-b00b-f4d74fe85eda'} Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:38:34.978254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:34.979761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:38:34.982108 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9756f09b-23dc-4b65-96ab-822ebd9465e8 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Returning 404 to user: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:38:34.985999 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9756f09b-23dc-4b65-96ab-822ebd9465e8 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.084244 Aug 01 07:38:34.991483 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 105/204] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:38:34 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda/os-volume_attachments => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:38:35.680629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-453558db-a9e0-4949-b7a2-b0be1739e062 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:35.681711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-453558db-a9e0-4949-b7a2-b0be1739e062 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:35.702327 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-453558db-a9e0-4949-b7a2-b0be1739e062 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:35.703298 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-453558db-a9e0-4949-b7a2-b0be1739e062 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:35.705698 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-453558db-a9e0-4949-b7a2-b0be1739e062 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:35.710564 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-453558db-a9e0-4949-b7a2-b0be1739e062 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:35.719991 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5f2d1583-4f4d-455b-95d2-e708dd0a475b tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:35.721281 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5f2d1583-4f4d-455b-95d2-e708dd0a475b tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:35.742477 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5f2d1583-4f4d-455b-95d2-e708dd0a475b tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:35.743038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5f2d1583-4f4d-455b-95d2-e708dd0a475b tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:35.743868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5f2d1583-4f4d-455b-95d2-e708dd0a475b tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:35.744303 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5f2d1583-4f4d-455b-95d2-e708dd0a475b tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:36.014994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-453558db-a9e0-4949-b7a2-b0be1739e062 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:36.031777 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-453558db-a9e0-4949-b7a2-b0be1739e062 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.357491 Aug 01 07:38:36.032962 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 100/205] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:35 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:36.280715 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5f2d1583-4f4d-455b-95d2-e708dd0a475b tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:36.289359 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5f2d1583-4f4d-455b-95d2-e708dd0a475b tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1314 microversion: 2.1 time: 0.575320 Aug 01 07:38:36.290114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 106/206] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:35 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:36.484056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a5bc0523-7c36-4a97-8c3b-13331325ea8f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:36.484544 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a5bc0523-7c36-4a97-8c3b-13331325ea8f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:36.493436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a5bc0523-7c36-4a97-8c3b-13331325ea8f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:36.493883 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a5bc0523-7c36-4a97-8c3b-13331325ea8f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:36.494654 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a5bc0523-7c36-4a97-8c3b-13331325ea8f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:36.495103 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a5bc0523-7c36-4a97-8c3b-13331325ea8f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:36.514985 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-a5bc0523-7c36-4a97-8c3b-13331325ea8f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] HTTP exception thrown: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a5bc0523-7c36-4a97-8c3b-13331325ea8f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Request method failure captured: Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda HTTP/1.1 Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KzKT2mmHmAyoZZLVJGiH9GKkcIO0EPnCiudgTJ-lqMg2sao54jlfkU29uu0KsFoov8p_y1PGQAJISGztusdfeqeJcNaB3Hd7CSnlyeRpC_dtcmfawd9npnHgMgCjWqBAfVAQmtuW_3YbXxVfclwQ4GABHBvmf566Fs9zSMlvNNihs Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 53bab4dbf0c34ae0be1be397427c99e8 Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:38:36.517266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 53bab4dbf0c34ae0be1be397427c99e8 Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-DeleteServersTestJSON-1761947773-project Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 905e317fcf49428ea1fa708dfabc958e Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-DeleteServersTestJSON-1761947773-project Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:36.518980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '5dcc6cbc-c57a-466f-b00b-f4d74fe85eda'} Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:38:36.523429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:36.525018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:36.526594 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a5bc0523-7c36-4a97-8c3b-13331325ea8f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Returning 404 to user: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:38:36.526594 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a5bc0523-7c36-4a97-8c3b-13331325ea8f tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 404 len: 111 microversion: 2.1 time: 0.038681 Aug 01 07:38:36.526594 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 101/207] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:38:36 2022] DELETE /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:38:36.534539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-75b828d8-8b9a-45f8-a083-6869e0e73e84 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:36.535688 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-75b828d8-8b9a-45f8-a083-6869e0e73e84 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] [instance: 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:36.545919 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-75b828d8-8b9a-45f8-a083-6869e0e73e84 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:36.548571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-75b828d8-8b9a-45f8-a083-6869e0e73e84 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:36.551423 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-75b828d8-8b9a-45f8-a083-6869e0e73e84 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:36.551978 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-75b828d8-8b9a-45f8-a083-6869e0e73e84 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:36.570092 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-75b828d8-8b9a-45f8-a083-6869e0e73e84 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] HTTP exception thrown: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-75b828d8-8b9a-45f8-a083-6869e0e73e84 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Request method failure captured: Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda HTTP/1.1 Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54KzKT2mmHmAyoZZLVJGiH9GKkcIO0EPnCiudgTJ-lqMg2sao54jlfkU29uu0KsFoov8p_y1PGQAJISGztusdfeqeJcNaB3Hd7CSnlyeRpC_dtcmfawd9npnHgMgCjWqBAfVAQmtuW_3YbXxVfclwQ4GABHBvmf566Fs9zSMlvNNihs Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 53bab4dbf0c34ae0be1be397427c99e8 Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:38:36.572514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53bab4dbf0c34ae0be1be397427c99e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 53bab4dbf0c34ae0be1be397427c99e8 Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-DeleteServersTestJSON-1761947773 Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-DeleteServersTestJSON-1761947773-project Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 905e317fcf49428ea1fa708dfabc958e Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-DeleteServersTestJSON-1761947773-project Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:36.573929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '5dcc6cbc-c57a-466f-b00b-f4d74fe85eda'} Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:38:36.576062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. Aug 01 07:38:36.577362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:38:36.578506 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-75b828d8-8b9a-45f8-a083-6869e0e73e84 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] Returning 404 to user: Instance 5dcc6cbc-c57a-466f-b00b-f4d74fe85eda could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:38:36.578506 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-75b828d8-8b9a-45f8-a083-6869e0e73e84 tempest-DeleteServersTestJSON-1761947773 tempest-DeleteServersTestJSON-1761947773-project] 10.222.0.40 "GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda" status: 404 len: 111 microversion: 2.1 time: 0.050182 Aug 01 07:38:36.578506 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 107/208] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:36 2022] GET /compute/v2.1/servers/5dcc6cbc-c57a-466f-b00b-f4d74fe85eda => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:38:37.056052 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cb1f679e-31cf-46b0-8f7e-dc519672bfe5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:37.057442 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-cb1f679e-31cf-46b0-8f7e-dc519672bfe5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:37.063826 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb1f679e-31cf-46b0-8f7e-dc519672bfe5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:37.064579 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb1f679e-31cf-46b0-8f7e-dc519672bfe5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:37.065652 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb1f679e-31cf-46b0-8f7e-dc519672bfe5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:37.066479 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb1f679e-31cf-46b0-8f7e-dc519672bfe5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:37.151479 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-e9dc815d-15d4-483c-bfa4-342448e63100 req-f4713f5a-a4b6-456e-91a4-c50cb4caef7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9f6006-ddb1-47ab-9290-c76a0e29f39b", "name": "network-vif-plugged", "status": "completed", "tag": "b5c0c1d8-297b-4406-96ab-a075eae66486"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:37.182787 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:37.184354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=8 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:37.189762 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-e9dc815d-15d4-483c-bfa4-342448e63100 req-f4713f5a-a4b6-456e-91a4-c50cb4caef7b service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:37.196388 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-e9dc815d-15d4-483c-bfa4-342448e63100 req-f4713f5a-a4b6-456e-91a4-c50cb4caef7b service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:37.226378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-e9dc815d-15d4-483c-bfa4-342448e63100 req-f4713f5a-a4b6-456e-91a4-c50cb4caef7b service nova] Creating event network-vif-plugged:b5c0c1d8-297b-4406-96ab-a075eae66486 for instance 0e9f6006-ddb1-47ab-9290-c76a0e29f39b on hv-cinder-73306 Aug 01 07:38:37.235239 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-e9dc815d-15d4-483c-bfa4-342448e63100 req-f4713f5a-a4b6-456e-91a4-c50cb4caef7b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110173 Aug 01 07:38:37.236078 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 108/209] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:38:37.318493 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e5926f57-3a20-461e-8f33-6843dc9b30fa tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:37.319334 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e5926f57-3a20-461e-8f33-6843dc9b30fa tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:37.336009 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e5926f57-3a20-461e-8f33-6843dc9b30fa tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:37.336576 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e5926f57-3a20-461e-8f33-6843dc9b30fa tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:37.337523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e5926f57-3a20-461e-8f33-6843dc9b30fa tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:37.338087 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e5926f57-3a20-461e-8f33-6843dc9b30fa tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:37.381819 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-cb1f679e-31cf-46b0-8f7e-dc519672bfe5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:37.398948 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-cb1f679e-31cf-46b0-8f7e-dc519672bfe5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.347071 Aug 01 07:38:37.403659 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 102/210] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:37 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:37.880454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e5926f57-3a20-461e-8f33-6843dc9b30fa tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:37.888717 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e5926f57-3a20-461e-8f33-6843dc9b30fa tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1314 microversion: 2.1 time: 0.579907 Aug 01 07:38:37.889930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 109/211] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:37 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:38.421873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-41d52654-9b09-44fe-9cab-ad8493fa983d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:38.423099 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-41d52654-9b09-44fe-9cab-ad8493fa983d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:38.425825 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=58 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:38.433838 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41d52654-9b09-44fe-9cab-ad8493fa983d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:38.434430 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41d52654-9b09-44fe-9cab-ad8493fa983d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:38.436526 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41d52654-9b09-44fe-9cab-ad8493fa983d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:38.436612 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-41d52654-9b09-44fe-9cab-ad8493fa983d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:38.611899 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-41d52654-9b09-44fe-9cab-ad8493fa983d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:38.624948 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-41d52654-9b09-44fe-9cab-ad8493fa983d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.206925 Aug 01 07:38:38.626456 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 103/212] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:38 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:38.909563 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b247338d-b66b-42d4-95f0-57d75ac71759 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:38.910142 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b247338d-b66b-42d4-95f0-57d75ac71759 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:38.920825 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b247338d-b66b-42d4-95f0-57d75ac71759 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:38.922036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b247338d-b66b-42d4-95f0-57d75ac71759 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:38.926297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b247338d-b66b-42d4-95f0-57d75ac71759 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:38.926857 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b247338d-b66b-42d4-95f0-57d75ac71759 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:39.182646 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b247338d-b66b-42d4-95f0-57d75ac71759 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:39.194718 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b247338d-b66b-42d4-95f0-57d75ac71759 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1314 microversion: 2.1 time: 0.288908 Aug 01 07:38:39.195912 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 110/213] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:38 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:39.650218 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e2c5d764-b8aa-414d-8471-a8488bb5be48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:39.652830 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e2c5d764-b8aa-414d-8471-a8488bb5be48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:39.660705 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e2c5d764-b8aa-414d-8471-a8488bb5be48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:39.665911 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e2c5d764-b8aa-414d-8471-a8488bb5be48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:39.667105 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e2c5d764-b8aa-414d-8471-a8488bb5be48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:39.668584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e2c5d764-b8aa-414d-8471-a8488bb5be48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:40.061908 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e2c5d764-b8aa-414d-8471-a8488bb5be48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:40.070946 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e2c5d764-b8aa-414d-8471-a8488bb5be48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.426105 Aug 01 07:38:40.091093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 104/214] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:39 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:40.218886 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7bd94354-3131-4848-8a6d-de920171824d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:40.220117 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7bd94354-3131-4848-8a6d-de920171824d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:40.231102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7bd94354-3131-4848-8a6d-de920171824d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:40.235842 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7bd94354-3131-4848-8a6d-de920171824d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:40.237248 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7bd94354-3131-4848-8a6d-de920171824d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:40.237845 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7bd94354-3131-4848-8a6d-de920171824d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:40.847045 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7bd94354-3131-4848-8a6d-de920171824d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:40.863006 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7bd94354-3131-4848-8a6d-de920171824d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1499 microversion: 2.1 time: 0.647017 Aug 01 07:38:40.864175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 111/215] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:40 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1499 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:41.102622 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-644217e1-12f5-44d5-b228-e2783da3b3fb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:41.103981 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-644217e1-12f5-44d5-b228-e2783da3b3fb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:41.112642 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-644217e1-12f5-44d5-b228-e2783da3b3fb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:41.114866 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-644217e1-12f5-44d5-b228-e2783da3b3fb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:41.116882 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-644217e1-12f5-44d5-b228-e2783da3b3fb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:41.121717 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-644217e1-12f5-44d5-b228-e2783da3b3fb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:41.476241 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-16f12e8e-dc22-449e-82aa-4c75878354d9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:41.476812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-16f12e8e-dc22-449e-82aa-4c75878354d9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:41.505694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-16f12e8e-dc22-449e-82aa-4c75878354d9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:41.507969 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-16f12e8e-dc22-449e-82aa-4c75878354d9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:41.509269 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-16f12e8e-dc22-449e-82aa-4c75878354d9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:41.513070 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-16f12e8e-dc22-449e-82aa-4c75878354d9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:41.578502 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-16f12e8e-dc22-449e-82aa-4c75878354d9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:38:41.770692 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-16f12e8e-dc22-449e-82aa-4c75878354d9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 204 len: 0 microversion: 2.1 time: 0.299670 Aug 01 07:38:41.781201 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 112/216] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:38:41 2022] DELETE /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 07:38:41.805710 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4339c6b3-bd71-46a4-92a7-cc0c5026694d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:41.811707 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4339c6b3-bd71-46a4-92a7-cc0c5026694d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:41.835736 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4339c6b3-bd71-46a4-92a7-cc0c5026694d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:41.836228 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4339c6b3-bd71-46a4-92a7-cc0c5026694d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:41.837019 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4339c6b3-bd71-46a4-92a7-cc0c5026694d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:41.837460 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4339c6b3-bd71-46a4-92a7-cc0c5026694d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:42.478527 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-644217e1-12f5-44d5-b228-e2783da3b3fb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:42.494029 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-644217e1-12f5-44d5-b228-e2783da3b3fb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 1.393040 Aug 01 07:38:42.495179 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 105/217] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:41 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:42.548586 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4339c6b3-bd71-46a4-92a7-cc0c5026694d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:42.557803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4339c6b3-bd71-46a4-92a7-cc0c5026694d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1505 microversion: 2.1 time: 0.774807 Aug 01 07:38:42.561783 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 113/218] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:41 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1505 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:43.527356 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6aab3384-5f3f-4146-b6d1-9aaeb53b8a62 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:43.528106 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6aab3384-5f3f-4146-b6d1-9aaeb53b8a62 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:43.543413 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6aab3384-5f3f-4146-b6d1-9aaeb53b8a62 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:43.544543 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6aab3384-5f3f-4146-b6d1-9aaeb53b8a62 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:43.547412 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6aab3384-5f3f-4146-b6d1-9aaeb53b8a62 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:43.549580 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6aab3384-5f3f-4146-b6d1-9aaeb53b8a62 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:43.584753 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-269c7552-e766-4d13-8886-3eb8036fd780 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:43.585385 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-269c7552-e766-4d13-8886-3eb8036fd780 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:43.600830 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-269c7552-e766-4d13-8886-3eb8036fd780 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:43.601295 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-269c7552-e766-4d13-8886-3eb8036fd780 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:43.608263 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-269c7552-e766-4d13-8886-3eb8036fd780 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:43.608762 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-269c7552-e766-4d13-8886-3eb8036fd780 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:43.888671 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-269c7552-e766-4d13-8886-3eb8036fd780 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:43.897344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-269c7552-e766-4d13-8886-3eb8036fd780 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1505 microversion: 2.1 time: 0.317920 Aug 01 07:38:43.901942 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 114/219] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:43 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:43.977422 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6aab3384-5f3f-4146-b6d1-9aaeb53b8a62 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:43.985668 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6aab3384-5f3f-4146-b6d1-9aaeb53b8a62 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.469827 Aug 01 07:38:43.988681 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 106/220] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:43 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:44.928384 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-aea5bcd3-2692-49ca-b1e1-b1464c4b7cd9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:44.929958 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-aea5bcd3-2692-49ca-b1e1-b1464c4b7cd9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:44.942784 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aea5bcd3-2692-49ca-b1e1-b1464c4b7cd9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:44.945734 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aea5bcd3-2692-49ca-b1e1-b1464c4b7cd9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:44.946558 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aea5bcd3-2692-49ca-b1e1-b1464c4b7cd9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:44.947176 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aea5bcd3-2692-49ca-b1e1-b1464c4b7cd9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:45.009576 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-73215496-efd8-4252-a07f-29e2d635f4a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:45.010185 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-73215496-efd8-4252-a07f-29e2d635f4a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:45.018311 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-73215496-efd8-4252-a07f-29e2d635f4a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:45.020091 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-73215496-efd8-4252-a07f-29e2d635f4a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:45.025928 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-73215496-efd8-4252-a07f-29e2d635f4a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:45.027531 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-73215496-efd8-4252-a07f-29e2d635f4a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:45.179263 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-aea5bcd3-2692-49ca-b1e1-b1464c4b7cd9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:45.193016 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-aea5bcd3-2692-49ca-b1e1-b1464c4b7cd9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1505 microversion: 2.1 time: 0.271599 Aug 01 07:38:45.196418 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 115/221] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:44 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:45.276588 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-73215496-efd8-4252-a07f-29e2d635f4a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:45.290690 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-73215496-efd8-4252-a07f-29e2d635f4a5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.285697 Aug 01 07:38:45.292098 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 107/222] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:45 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:46.242754 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1c74dca7-2187-4ef1-afd1-8273ac5fc54d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:46.243553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1c74dca7-2187-4ef1-afd1-8273ac5fc54d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:46.248215 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:46.257454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c74dca7-2187-4ef1-afd1-8273ac5fc54d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:46.258366 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c74dca7-2187-4ef1-afd1-8273ac5fc54d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:46.261110 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c74dca7-2187-4ef1-afd1-8273ac5fc54d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:46.261757 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c74dca7-2187-4ef1-afd1-8273ac5fc54d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:46.313880 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ba7796ba-9ebf-4d7a-a167-04a16b6168da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:46.314724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ba7796ba-9ebf-4d7a-a167-04a16b6168da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:46.323665 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba7796ba-9ebf-4d7a-a167-04a16b6168da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:46.325828 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba7796ba-9ebf-4d7a-a167-04a16b6168da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:46.343992 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba7796ba-9ebf-4d7a-a167-04a16b6168da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:46.344705 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba7796ba-9ebf-4d7a-a167-04a16b6168da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:46.543686 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1c74dca7-2187-4ef1-afd1-8273ac5fc54d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:46.553594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1c74dca7-2187-4ef1-afd1-8273ac5fc54d tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 200 len: 1505 microversion: 2.1 time: 0.336010 Aug 01 07:38:46.554737 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 116/223] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:46 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:46.605695 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ba7796ba-9ebf-4d7a-a167-04a16b6168da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:46.615566 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ba7796ba-9ebf-4d7a-a167-04a16b6168da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.306372 Aug 01 07:38:46.617127 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 108/224] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:46 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:46.846335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8beccbf9-5922-49e3-bfcb-42f9fb8eb080 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Action: 'create', calling method: .version_select at 0x7fd018afaca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1321786183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIhu5Goo2zlN4w68XeamKKUTlge8/SykEAyMV4uOaUnfWLJmkNPd0kSb9E4m0HeTJ1EaibAKdt4Jp4l0Wn523OAzxn3PO0uUspLcG7RffT8LLD1Ty+ax7R1T1swBqWHIg=="}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:46.864562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-3db82515-b11a-40c3-802a-973b6c1b9558 req-ff6ea4bd-5d94-438c-bf9a-00463bcd231d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9f6006-ddb1-47ab-9290-c76a0e29f39b", "name": "network-vif-deleted", "tag": "b5c0c1d8-297b-4406-96ab-a075eae66486"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:46.880750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-3db82515-b11a-40c3-802a-973b6c1b9558 req-ff6ea4bd-5d94-438c-bf9a-00463bcd231d service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:46.881300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-3db82515-b11a-40c3-802a-973b6c1b9558 req-ff6ea4bd-5d94-438c-bf9a-00463bcd231d service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:46.888489 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-8beccbf9-5922-49e3-bfcb-42f9fb8eb080 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Getting quotas for project f07c6f16ad7747c5a42b4d0351a44545. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:38:46.899324 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-8beccbf9-5922-49e3-bfcb-42f9fb8eb080 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Getting quotas for user d714badcdf8e4461ae1f7ebe4f0c82d4 and project f07c6f16ad7747c5a42b4d0351a44545. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:38:46.900483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-3db82515-b11a-40c3-802a-973b6c1b9558 req-ff6ea4bd-5d94-438c-bf9a-00463bcd231d service nova] Creating event network-vif-deleted:b5c0c1d8-297b-4406-96ab-a075eae66486 for instance 0e9f6006-ddb1-47ab-9290-c76a0e29f39b on hv-cinder-73306 Aug 01 07:38:46.914129 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-3db82515-b11a-40c3-802a-973b6c1b9558 req-ff6ea4bd-5d94-438c-bf9a-00463bcd231d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053210 Aug 01 07:38:46.918052 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 109/225] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:38:46.962015 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8beccbf9-5922-49e3-bfcb-42f9fb8eb080 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.405958 Aug 01 07:38:46.968664 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 117/226] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 1 07:38:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:38:47.577438 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a752466d-e25f-4f26-8397-b2865c60f746 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:47.578888 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a752466d-e25f-4f26-8397-b2865c60f746 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 0e9f6006-ddb1-47ab-9290-c76a0e29f39b] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:47.600981 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a752466d-e25f-4f26-8397-b2865c60f746 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:47.602725 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a752466d-e25f-4f26-8397-b2865c60f746 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:47.603996 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a752466d-e25f-4f26-8397-b2865c60f746 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:47.604965 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a752466d-e25f-4f26-8397-b2865c60f746 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:47.625270 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-a752466d-e25f-4f26-8397-b2865c60f746 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] HTTP exception thrown: Instance 0e9f6006-ddb1-47ab-9290-c76a0e29f39b could not be found. Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a752466d-e25f-4f26-8397-b2865c60f746 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Request method failure captured: Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b HTTP/1.1 Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54LvrtpfaCL9P9k1Bk_AiY4eErWxnOvE0oDE7dlwrLn9wQZvcqibgjdM5Kz4Fzv3kVr5OOHWEjkGN4PUUL3mFxG36qc82kEqmeS2uEPal1YDuwlSveEBPMcmP0T2CjuPX63sobO8MndP-JSEVyeDj17PiF40ULG5zPNJ0q6zpmz4CSM Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: a5b0cb87dfc4461e9911c7e62b6ab959 Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-VolumesActionsTest-736259158 Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:38:47.627549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5b0cb87dfc4461e9911c7e62b6ab959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a5b0cb87dfc4461e9911c7e62b6ab959"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5b0cb87dfc4461e9911c7e62b6ab959"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a5b0cb87dfc4461e9911c7e62b6ab959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-VolumesActionsTest-736259158 Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: a5b0cb87dfc4461e9911c7e62b6ab959 Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-VolumesActionsTest-736259158 Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-VolumesActionsTest-736259158-project Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 9255edea8b504727a587443e124f3e7a Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-VolumesActionsTest-736259158-project Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 0e9f6006-ddb1-47ab-9290-c76a0e29f39b could not be found. Aug 01 07:38:47.629464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '0e9f6006-ddb1-47ab-9290-c76a0e29f39b'} Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e9f6006-ddb1-47ab-9290-c76a0e29f39b could not be found. Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:38:47.630539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e9f6006-ddb1-47ab-9290-c76a0e29f39b could not be found. Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e9f6006-ddb1-47ab-9290-c76a0e29f39b could not be found. Aug 01 07:38:47.632368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:38:47.633556 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a752466d-e25f-4f26-8397-b2865c60f746 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Returning 404 to user: Instance 0e9f6006-ddb1-47ab-9290-c76a0e29f39b could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:38:47.633556 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a752466d-e25f-4f26-8397-b2865c60f746 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b" status: 404 len: 111 microversion: 2.1 time: 0.057954 Aug 01 07:38:47.633556 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 110/227] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:47 2022] GET /compute/v2.1/servers/0e9f6006-ddb1-47ab-9290-c76a0e29f39b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 07:38:47.649241 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f7beb0e6-19a9-47b5-8564-23a3494aeb48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:47.650496 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f7beb0e6-19a9-47b5-8564-23a3494aeb48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:47.658317 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f7beb0e6-19a9-47b5-8564-23a3494aeb48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:47.660525 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f7beb0e6-19a9-47b5-8564-23a3494aeb48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:47.661516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f7beb0e6-19a9-47b5-8564-23a3494aeb48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:47.662642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f7beb0e6-19a9-47b5-8564-23a3494aeb48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:47.813021 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-374584928", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "networks": [{"uuid": "8898159d-f24d-4cd2-9340-d84903b2bbea"}]}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:47.881775 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] validate_networks() for [('8898159d-f24d-4cd2-9340-d84903b2bbea', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:38:47.958256 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f7beb0e6-19a9-47b5-8564-23a3494aeb48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:47.979216 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f7beb0e6-19a9-47b5-8564-23a3494aeb48 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.341196 Aug 01 07:38:47.993345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 118/228] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:47 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:48.462014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:38:48.463790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:38:48.463790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:38:48.463790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:38:48.468996 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:38:48.481555 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:48.482226 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:48.483579 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:48.484197 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:48.506342 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Getting quotas for project a5b0cb87dfc4461e9911c7e62b6ab959. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:38:48.512927 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Getting quotas for user 9255edea8b504727a587443e124f3e7a and project a5b0cb87dfc4461e9911c7e62b6ab959. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:38:48.527570 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:38:48.529812 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:38:48.607772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-65303650-8158-496f-be5f-4879ad12b356 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799136 Aug 01 07:38:48.619420 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 111/229] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:38:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 07:38:48.634892 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5f0a5ad7-8cb5-4e4b-a83d-ad6aa8275e97 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:48.637960 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5f0a5ad7-8cb5-4e4b-a83d-ad6aa8275e97 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:48.717304 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5f0a5ad7-8cb5-4e4b-a83d-ad6aa8275e97 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:48.729783 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5f0a5ad7-8cb5-4e4b-a83d-ad6aa8275e97 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1213 microversion: 2.1 time: 0.108901 Aug 01 07:38:48.731596 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 119/230] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:48 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:49.004130 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d12b045c-9a74-4ea3-b19e-b56dee038516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:49.005052 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d12b045c-9a74-4ea3-b19e-b56dee038516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:49.014671 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d12b045c-9a74-4ea3-b19e-b56dee038516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:49.015196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d12b045c-9a74-4ea3-b19e-b56dee038516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:49.016060 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d12b045c-9a74-4ea3-b19e-b56dee038516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:49.016724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d12b045c-9a74-4ea3-b19e-b56dee038516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:49.222101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d12b045c-9a74-4ea3-b19e-b56dee038516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:49.231237 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d12b045c-9a74-4ea3-b19e-b56dee038516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.234996 Aug 01 07:38:49.232129 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 112/231] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:48 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:49.753006 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4c1eb3e5-fde4-4d23-8747-63753f678db9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:49.754722 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4c1eb3e5-fde4-4d23-8747-63753f678db9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:49.769566 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c1eb3e5-fde4-4d23-8747-63753f678db9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:49.770224 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c1eb3e5-fde4-4d23-8747-63753f678db9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:49.772121 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c1eb3e5-fde4-4d23-8747-63753f678db9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:49.772808 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c1eb3e5-fde4-4d23-8747-63753f678db9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:49.844041 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4c1eb3e5-fde4-4d23-8747-63753f678db9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:49.855268 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4c1eb3e5-fde4-4d23-8747-63753f678db9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1265 microversion: 2.1 time: 0.106706 Aug 01 07:38:49.855825 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 120/232] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:49 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:50.256036 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2b750f3b-1fce-47a1-9ce1-ca3305f54198 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:50.257790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2b750f3b-1fce-47a1-9ce1-ca3305f54198 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:50.266906 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2b750f3b-1fce-47a1-9ce1-ca3305f54198 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:50.269449 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2b750f3b-1fce-47a1-9ce1-ca3305f54198 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:50.270870 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2b750f3b-1fce-47a1-9ce1-ca3305f54198 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:50.272176 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2b750f3b-1fce-47a1-9ce1-ca3305f54198 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:50.294344 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:50.507700 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2b750f3b-1fce-47a1-9ce1-ca3305f54198 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:50.523430 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2b750f3b-1fce-47a1-9ce1-ca3305f54198 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.273956 Aug 01 07:38:50.525137 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 113/233] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:50 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:50.886474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4e6bff9d-af7c-411e-921c-eda316537eb1 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:50.887771 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4e6bff9d-af7c-411e-921c-eda316537eb1 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:50.900547 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4e6bff9d-af7c-411e-921c-eda316537eb1 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:50.901014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4e6bff9d-af7c-411e-921c-eda316537eb1 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:50.901792 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4e6bff9d-af7c-411e-921c-eda316537eb1 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:50.902228 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4e6bff9d-af7c-411e-921c-eda316537eb1 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:50.906642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:51.123125 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4e6bff9d-af7c-411e-921c-eda316537eb1 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:51.132469 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4e6bff9d-af7c-411e-921c-eda316537eb1 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1313 microversion: 2.1 time: 0.252018 Aug 01 07:38:51.133165 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 121/234] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:50 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:51.548157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-bec8cc09-bd92-4288-93fd-ab5ac741c5eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:51.548804 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-bec8cc09-bd92-4288-93fd-ab5ac741c5eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:51.562027 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bec8cc09-bd92-4288-93fd-ab5ac741c5eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:51.562503 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bec8cc09-bd92-4288-93fd-ab5ac741c5eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:51.564572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bec8cc09-bd92-4288-93fd-ab5ac741c5eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:51.565168 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bec8cc09-bd92-4288-93fd-ab5ac741c5eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:52.165289 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-dd79929a-3ae6-4fdc-b849-60c52087c9e7 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:52.167945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-dd79929a-3ae6-4fdc-b849-60c52087c9e7 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:52.184336 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-bec8cc09-bd92-4288-93fd-ab5ac741c5eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:52.188353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd79929a-3ae6-4fdc-b849-60c52087c9e7 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:52.190721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd79929a-3ae6-4fdc-b849-60c52087c9e7 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:52.192784 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd79929a-3ae6-4fdc-b849-60c52087c9e7 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:52.193552 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd79929a-3ae6-4fdc-b849-60c52087c9e7 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:52.224814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-bec8cc09-bd92-4288-93fd-ab5ac741c5eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.680619 Aug 01 07:38:52.229974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 114/235] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:51 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:52.391717 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-dd79929a-3ae6-4fdc-b849-60c52087c9e7 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:52.406013 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-dd79929a-3ae6-4fdc-b849-60c52087c9e7 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1313 microversion: 2.1 time: 0.251856 Aug 01 07:38:52.406819 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 122/236] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:52 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:52.433505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-e5e0cc62-bee4-40f8-8d7c-8e7be279fc49 req-c2db72eb-cc45-4ff8-a624-708dcdebb447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45bd7ced-496c-4b44-89db-ef9261de87cb", "tag": "de07c518-3818-45c8-94fc-bdfd7c715edb"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:52.475718 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-e5e0cc62-bee4-40f8-8d7c-8e7be279fc49 req-c2db72eb-cc45-4ff8-a624-708dcdebb447 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:52.482470 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-e5e0cc62-bee4-40f8-8d7c-8e7be279fc49 req-c2db72eb-cc45-4ff8-a624-708dcdebb447 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:52.518505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-e5e0cc62-bee4-40f8-8d7c-8e7be279fc49 req-c2db72eb-cc45-4ff8-a624-708dcdebb447 service nova] Creating event network-changed:de07c518-3818-45c8-94fc-bdfd7c715edb for instance 45bd7ced-496c-4b44-89db-ef9261de87cb on hv-cinder-73306 Aug 01 07:38:52.524151 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-e5e0cc62-bee4-40f8-8d7c-8e7be279fc49 req-c2db72eb-cc45-4ff8-a624-708dcdebb447 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098955 Aug 01 07:38:52.525062 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 115/237] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:38:53.251835 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6242de24-922e-406d-8084-f78982e2add5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:53.253434 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6242de24-922e-406d-8084-f78982e2add5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:53.262004 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6242de24-922e-406d-8084-f78982e2add5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:53.262454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6242de24-922e-406d-8084-f78982e2add5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:53.263769 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6242de24-922e-406d-8084-f78982e2add5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:53.264224 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6242de24-922e-406d-8084-f78982e2add5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:53.430416 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ba8f1fc9-7073-43f3-bab6-407b71ba3199 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:53.431365 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ba8f1fc9-7073-43f3-bab6-407b71ba3199 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:53.445393 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba8f1fc9-7073-43f3-bab6-407b71ba3199 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:53.445875 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba8f1fc9-7073-43f3-bab6-407b71ba3199 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:53.446672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba8f1fc9-7073-43f3-bab6-407b71ba3199 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:53.448371 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba8f1fc9-7073-43f3-bab6-407b71ba3199 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:53.456123 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6242de24-922e-406d-8084-f78982e2add5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:53.466827 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6242de24-922e-406d-8084-f78982e2add5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.218919 Aug 01 07:38:53.471537 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 123/238] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:53 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:53.675453 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ba8f1fc9-7073-43f3-bab6-407b71ba3199 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:53.686056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ba8f1fc9-7073-43f3-bab6-407b71ba3199 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1313 microversion: 2.1 time: 0.260323 Aug 01 07:38:53.687456 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 116/239] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:53 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:54.490153 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-245dec2a-70e4-4677-aaaa-833ff12c12e0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:54.490819 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-245dec2a-70e4-4677-aaaa-833ff12c12e0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:54.497940 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-245dec2a-70e4-4677-aaaa-833ff12c12e0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:54.498719 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-245dec2a-70e4-4677-aaaa-833ff12c12e0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:54.499689 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-245dec2a-70e4-4677-aaaa-833ff12c12e0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:54.500425 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-245dec2a-70e4-4677-aaaa-833ff12c12e0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:54.688254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-245dec2a-70e4-4677-aaaa-833ff12c12e0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:54.696482 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-245dec2a-70e4-4677-aaaa-833ff12c12e0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1521 microversion: 2.1 time: 0.210911 Aug 01 07:38:54.697052 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 124/240] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:54 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:54.708110 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6a9cebce-3da4-47fa-9033-218680185e1e tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:54.709367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6a9cebce-3da4-47fa-9033-218680185e1e tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:54.715348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6a9cebce-3da4-47fa-9033-218680185e1e tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:54.715797 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6a9cebce-3da4-47fa-9033-218680185e1e tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:54.716775 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6a9cebce-3da4-47fa-9033-218680185e1e tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:54.717212 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6a9cebce-3da4-47fa-9033-218680185e1e tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:54.880711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6a9cebce-3da4-47fa-9033-218680185e1e tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:54.893731 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6a9cebce-3da4-47fa-9033-218680185e1e tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1313 microversion: 2.1 time: 0.189891 Aug 01 07:38:54.894623 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 117/241] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:54 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:55.718354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-94c0342a-65ed-4672-be7c-293fca51f128 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:55.718960 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-94c0342a-65ed-4672-be7c-293fca51f128 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:55.727574 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-94c0342a-65ed-4672-be7c-293fca51f128 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:55.728324 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-94c0342a-65ed-4672-be7c-293fca51f128 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:55.729325 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-94c0342a-65ed-4672-be7c-293fca51f128 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:55.729983 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-94c0342a-65ed-4672-be7c-293fca51f128 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:55.916320 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3ad09b11-509d-4c43-ad80-b332126d5b9c tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:55.916924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3ad09b11-509d-4c43-ad80-b332126d5b9c tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:55.925067 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3ad09b11-509d-4c43-ad80-b332126d5b9c tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:55.926840 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3ad09b11-509d-4c43-ad80-b332126d5b9c tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:55.928160 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3ad09b11-509d-4c43-ad80-b332126d5b9c tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:55.928976 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3ad09b11-509d-4c43-ad80-b332126d5b9c tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:55.930043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-94c0342a-65ed-4672-be7c-293fca51f128 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:55.941198 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-94c0342a-65ed-4672-be7c-293fca51f128 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1501 microversion: 2.1 time: 0.226522 Aug 01 07:38:55.942044 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 125/242] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:55 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:55.966196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c7f8050d-dd5a-42fa-9dc1-9248204da45a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:55.966900 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c7f8050d-dd5a-42fa-9dc1-9248204da45a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:55.973944 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c7f8050d-dd5a-42fa-9dc1-9248204da45a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:55.984120 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c7f8050d-dd5a-42fa-9dc1-9248204da45a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:55.984999 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c7f8050d-dd5a-42fa-9dc1-9248204da45a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:55.985748 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c7f8050d-dd5a-42fa-9dc1-9248204da45a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:56.155518 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3ad09b11-509d-4c43-ad80-b332126d5b9c tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:56.161403 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c7f8050d-dd5a-42fa-9dc1-9248204da45a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:56.164449 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3ad09b11-509d-4c43-ad80-b332126d5b9c tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1313 microversion: 2.1 time: 0.251273 Aug 01 07:38:56.165211 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 118/243] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:55 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:56.171594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c7f8050d-dd5a-42fa-9dc1-9248204da45a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1516 microversion: 2.1 time: 0.212449 Aug 01 07:38:56.172672 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 126/244] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:55 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:57.186377 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cb4c3879-7a7b-4db8-be16-4985b24e7904 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:57.187049 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-cb4c3879-7a7b-4db8-be16-4985b24e7904 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:57.193158 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb4c3879-7a7b-4db8-be16-4985b24e7904 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:57.193612 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb4c3879-7a7b-4db8-be16-4985b24e7904 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:57.194378 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb4c3879-7a7b-4db8-be16-4985b24e7904 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:57.194813 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb4c3879-7a7b-4db8-be16-4985b24e7904 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:57.328366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-cb4c3879-7a7b-4db8-be16-4985b24e7904 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:57.336813 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-cb4c3879-7a7b-4db8-be16-4985b24e7904 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1313 microversion: 2.1 time: 0.154252 Aug 01 07:38:57.337393 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 119/245] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:57 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:57.706442 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d219d712-535c-400c-af42-f032c8daf0e6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:57.708749 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d219d712-535c-400c-af42-f032c8daf0e6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:57.715262 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d219d712-535c-400c-af42-f032c8daf0e6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:57.715965 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d219d712-535c-400c-af42-f032c8daf0e6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:57.716931 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d219d712-535c-400c-af42-f032c8daf0e6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:57.717637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d219d712-535c-400c-af42-f032c8daf0e6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:57.746970 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-d219d712-535c-400c-af42-f032c8daf0e6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lazy-loading 'flavor' on Instance uuid 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:38:57.828027 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d219d712-535c-400c-af42-f032c8daf0e6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e/action" status: 200 len: 32 microversion: 2.1 time: 0.126133 Aug 01 07:38:57.828966 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 127/246] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:38:57 2022] POST /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e/action => generated 32 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 07:38:57.837953 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-c9590064-2ab8-43da-8149-c32138a9e1d1 req-86292849-7ca6-494c-bef4-fa9e57d1ba1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45bd7ced-496c-4b44-89db-ef9261de87cb", "name": "network-vif-plugged", "status": "completed", "tag": "de07c518-3818-45c8-94fc-bdfd7c715edb"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:38:57.838810 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-52427020-a7ea-4d95-b966-89725d03c5a3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:57.839525 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-52427020-a7ea-4d95-b966-89725d03c5a3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:57.846831 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-52427020-a7ea-4d95-b966-89725d03c5a3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:57.847601 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-52427020-a7ea-4d95-b966-89725d03c5a3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:57.848896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-52427020-a7ea-4d95-b966-89725d03c5a3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:57.849562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-52427020-a7ea-4d95-b966-89725d03c5a3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:57.849681 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-c9590064-2ab8-43da-8149-c32138a9e1d1 req-86292849-7ca6-494c-bef4-fa9e57d1ba1b service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:57.850424 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-c9590064-2ab8-43da-8149-c32138a9e1d1 req-86292849-7ca6-494c-bef4-fa9e57d1ba1b service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:57.872664 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-c9590064-2ab8-43da-8149-c32138a9e1d1 req-86292849-7ca6-494c-bef4-fa9e57d1ba1b service nova] Creating event network-vif-plugged:de07c518-3818-45c8-94fc-bdfd7c715edb for instance 45bd7ced-496c-4b44-89db-ef9261de87cb on hv-cinder-73306 Aug 01 07:38:57.886112 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-c9590064-2ab8-43da-8149-c32138a9e1d1 req-86292849-7ca6-494c-bef4-fa9e57d1ba1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053124 Aug 01 07:38:57.886923 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 120/247] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:38:58.089890 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-52427020-a7ea-4d95-b966-89725d03c5a3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:58.095221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-52427020-a7ea-4d95-b966-89725d03c5a3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.260581 Aug 01 07:38:58.096200 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 128/248] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:57 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:38:58.365171 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-306b61ba-270c-4cd9-93fa-bb98b4873e33 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:58.365863 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-306b61ba-270c-4cd9-93fa-bb98b4873e33 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:58.373936 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-306b61ba-270c-4cd9-93fa-bb98b4873e33 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:58.374388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-306b61ba-270c-4cd9-93fa-bb98b4873e33 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:58.375587 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-306b61ba-270c-4cd9-93fa-bb98b4873e33 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:58.376216 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-306b61ba-270c-4cd9-93fa-bb98b4873e33 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:58.494616 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:58.523849 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=6 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:58.528494 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-306b61ba-270c-4cd9-93fa-bb98b4873e33 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:58.537092 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-306b61ba-270c-4cd9-93fa-bb98b4873e33 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1313 microversion: 2.1 time: 0.182965 Aug 01 07:38:58.537754 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 121/249] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:58 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:59.118876 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-08c1ac80-97de-43da-a966-7b42bd87788d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:59.119508 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-08c1ac80-97de-43da-a966-7b42bd87788d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:59.121933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=6 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:38:59.129735 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-08c1ac80-97de-43da-a966-7b42bd87788d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:59.130181 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-08c1ac80-97de-43da-a966-7b42bd87788d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:59.130980 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-08c1ac80-97de-43da-a966-7b42bd87788d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:59.131433 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-08c1ac80-97de-43da-a966-7b42bd87788d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:59.408631 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-08c1ac80-97de-43da-a966-7b42bd87788d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:59.416140 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-08c1ac80-97de-43da-a966-7b42bd87788d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.302875 Aug 01 07:38:59.416780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 129/250] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:59 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:38:59.557744 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-78b7d091-efd6-4872-a463-5eb0754960c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:38:59.558347 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-78b7d091-efd6-4872-a463-5eb0754960c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:38:59.567579 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78b7d091-efd6-4872-a463-5eb0754960c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:59.568030 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78b7d091-efd6-4872-a463-5eb0754960c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:59.568799 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78b7d091-efd6-4872-a463-5eb0754960c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:38:59.569269 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78b7d091-efd6-4872-a463-5eb0754960c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:38:59.706944 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-78b7d091-efd6-4872-a463-5eb0754960c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:38:59.715555 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-78b7d091-efd6-4872-a463-5eb0754960c9 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1313 microversion: 2.1 time: 0.161628 Aug 01 07:38:59.716354 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 122/251] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:38:59 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:00.438407 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5016cd8f-a435-48bb-8324-d047e1ca57c9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:00.439861 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5016cd8f-a435-48bb-8324-d047e1ca57c9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:00.453173 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5016cd8f-a435-48bb-8324-d047e1ca57c9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:00.455874 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5016cd8f-a435-48bb-8324-d047e1ca57c9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:00.456718 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5016cd8f-a435-48bb-8324-d047e1ca57c9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:00.457243 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5016cd8f-a435-48bb-8324-d047e1ca57c9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:00.656572 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5016cd8f-a435-48bb-8324-d047e1ca57c9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:00.665293 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5016cd8f-a435-48bb-8324-d047e1ca57c9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.232172 Aug 01 07:39:00.666404 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 130/252] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:00 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:00.742579 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-912fc566-63fb-469a-abfd-3d386cdac882 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:00.743245 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-912fc566-63fb-469a-abfd-3d386cdac882 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:00.750064 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-912fc566-63fb-469a-abfd-3d386cdac882 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:00.750813 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-912fc566-63fb-469a-abfd-3d386cdac882 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:00.751874 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-912fc566-63fb-469a-abfd-3d386cdac882 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:00.752469 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-912fc566-63fb-469a-abfd-3d386cdac882 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:00.917840 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-912fc566-63fb-469a-abfd-3d386cdac882 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:00.929619 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-912fc566-63fb-469a-abfd-3d386cdac882 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1498 microversion: 2.1 time: 0.191222 Aug 01 07:39:00.945996 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 123/253] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:00 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1498 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:01.547758 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-57b19a78-178e-4bc1-9299-d162b026c91a tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:01.548544 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-57b19a78-178e-4bc1-9299-d162b026c91a tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:01.556294 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57b19a78-178e-4bc1-9299-d162b026c91a tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:01.556737 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57b19a78-178e-4bc1-9299-d162b026c91a tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:01.557505 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57b19a78-178e-4bc1-9299-d162b026c91a tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:01.557934 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57b19a78-178e-4bc1-9299-d162b026c91a tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:01.602388 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-57b19a78-178e-4bc1-9299-d162b026c91a tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:39:01.688052 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7e4c94b2-aa1c-4bce-bbc3-e8285813f3ce tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:01.689489 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7e4c94b2-aa1c-4bce-bbc3-e8285813f3ce tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:01.696374 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-57b19a78-178e-4bc1-9299-d162b026c91a tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "DELETE /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 204 len: 0 microversion: 2.1 time: 0.151963 Aug 01 07:39:01.697379 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 131/254] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:39:01 2022] DELETE /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:39:01.700163 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e4c94b2-aa1c-4bce-bbc3-e8285813f3ce tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:01.701531 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e4c94b2-aa1c-4bce-bbc3-e8285813f3ce tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:01.702674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e4c94b2-aa1c-4bce-bbc3-e8285813f3ce tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:01.703619 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e4c94b2-aa1c-4bce-bbc3-e8285813f3ce tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:01.707306 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-01cfb1f7-3e63-483e-8902-937c76031e75 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:01.708331 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-01cfb1f7-3e63-483e-8902-937c76031e75 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:01.714574 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-01cfb1f7-3e63-483e-8902-937c76031e75 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:01.715086 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-01cfb1f7-3e63-483e-8902-937c76031e75 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:01.715865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-01cfb1f7-3e63-483e-8902-937c76031e75 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:01.716883 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-01cfb1f7-3e63-483e-8902-937c76031e75 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:01.892889 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-01cfb1f7-3e63-483e-8902-937c76031e75 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:01.899426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7e4c94b2-aa1c-4bce-bbc3-e8285813f3ce tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:01.901434 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-01cfb1f7-3e63-483e-8902-937c76031e75 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1504 microversion: 2.1 time: 0.199473 Aug 01 07:39:01.902170 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 132/255] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:01 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:01.910218 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7e4c94b2-aa1c-4bce-bbc3-e8285813f3ce tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.227242 Aug 01 07:39:01.910954 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 124/256] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:01 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:02.922669 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-360cbf18-9d68-4c5b-9cb5-e512ec6841f2 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:02.923503 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-360cbf18-9d68-4c5b-9cb5-e512ec6841f2 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:02.934076 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-360cbf18-9d68-4c5b-9cb5-e512ec6841f2 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:02.935146 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-360cbf18-9d68-4c5b-9cb5-e512ec6841f2 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:02.935404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-31a62158-5097-4c58-8b74-99bd44ee04f9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:02.936011 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-31a62158-5097-4c58-8b74-99bd44ee04f9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:02.936442 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-360cbf18-9d68-4c5b-9cb5-e512ec6841f2 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:02.936885 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-360cbf18-9d68-4c5b-9cb5-e512ec6841f2 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:02.942109 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-31a62158-5097-4c58-8b74-99bd44ee04f9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:02.942557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-31a62158-5097-4c58-8b74-99bd44ee04f9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:02.943337 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-31a62158-5097-4c58-8b74-99bd44ee04f9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:02.943769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-31a62158-5097-4c58-8b74-99bd44ee04f9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:03.123522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-31a62158-5097-4c58-8b74-99bd44ee04f9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:03.136871 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-31a62158-5097-4c58-8b74-99bd44ee04f9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.204919 Aug 01 07:39:03.139672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 125/257] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:02 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:03.164649 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-360cbf18-9d68-4c5b-9cb5-e512ec6841f2 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:03.173525 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-360cbf18-9d68-4c5b-9cb5-e512ec6841f2 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1504 microversion: 2.1 time: 0.255538 Aug 01 07:39:03.174146 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 133/258] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:02 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:04.100961 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-032b9a0d-1937-4ccb-813b-91a85d1b7fe9 req-a9667a7f-9bb3-4abd-9f08-ac1f135c35a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45bd7ced-496c-4b44-89db-ef9261de87cb", "name": "network-vif-deleted", "tag": "de07c518-3818-45c8-94fc-bdfd7c715edb"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:04.112734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-032b9a0d-1937-4ccb-813b-91a85d1b7fe9 req-a9667a7f-9bb3-4abd-9f08-ac1f135c35a9 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:04.113182 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-032b9a0d-1937-4ccb-813b-91a85d1b7fe9 req-a9667a7f-9bb3-4abd-9f08-ac1f135c35a9 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:04.126821 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-032b9a0d-1937-4ccb-813b-91a85d1b7fe9 req-a9667a7f-9bb3-4abd-9f08-ac1f135c35a9 service nova] Creating event network-vif-deleted:de07c518-3818-45c8-94fc-bdfd7c715edb for instance 45bd7ced-496c-4b44-89db-ef9261de87cb on hv-cinder-73306 Aug 01 07:39:04.133708 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-032b9a0d-1937-4ccb-813b-91a85d1b7fe9 req-a9667a7f-9bb3-4abd-9f08-ac1f135c35a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036586 Aug 01 07:39:04.134622 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 126/259] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:39:04.161604 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d36768bf-7d28-485c-91b4-7558918779a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:04.162210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d36768bf-7d28-485c-91b4-7558918779a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:04.168882 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d36768bf-7d28-485c-91b4-7558918779a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:04.169344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d36768bf-7d28-485c-91b4-7558918779a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:04.170127 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d36768bf-7d28-485c-91b4-7558918779a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:04.170569 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d36768bf-7d28-485c-91b4-7558918779a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:04.179866 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:04.196387 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:04.197094 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:04.215305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:04.215305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:04.215305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:04.215305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:04.247851 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:04.248311 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:04.248793 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lazy-loading 'fault' on Instance uuid 45bd7ced-496c-4b44-89db-ef9261de87cb {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:39:04.300408 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9255edea8b504727a587443e124f3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b0cb87dfc4461e9911c7e62b6ab959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:04.311139 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c3ab7b49-ed63-416a-b7d9-ad1f86b52ea0 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 200 len: 1303 microversion: 2.1 time: 0.119154 Aug 01 07:39:04.312109 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 127/260] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:04 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:04.378072 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d36768bf-7d28-485c-91b4-7558918779a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:04.386510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d36768bf-7d28-485c-91b4-7558918779a8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.229546 Aug 01 07:39:04.387090 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 134/261] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:04 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:04.733121 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2d64f373-18ad-4d6e-a4fc-860d27b78740 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:04.733757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2d64f373-18ad-4d6e-a4fc-860d27b78740 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:04.748131 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d64f373-18ad-4d6e-a4fc-860d27b78740 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:04.748709 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d64f373-18ad-4d6e-a4fc-860d27b78740 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:04.752961 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d64f373-18ad-4d6e-a4fc-860d27b78740 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:04.753503 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d64f373-18ad-4d6e-a4fc-860d27b78740 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:04.784493 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2d64f373-18ad-4d6e-a4fc-860d27b78740 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/ips" status: 200 len: 151 microversion: 2.20 time: 0.060714 Aug 01 07:39:04.785073 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 128/262] 10.222.0.40 () {60 vars in 1289 bytes} [Mon Aug 1 07:39:04 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:39:05.332414 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e72a8089-abb6-4a0a-beaa-cd629d560bd6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:05.333081 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e72a8089-abb6-4a0a-beaa-cd629d560bd6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] [instance: 45bd7ced-496c-4b44-89db-ef9261de87cb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:05.339551 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e72a8089-abb6-4a0a-beaa-cd629d560bd6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:05.340008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e72a8089-abb6-4a0a-beaa-cd629d560bd6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:05.340775 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e72a8089-abb6-4a0a-beaa-cd629d560bd6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:05.341216 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e72a8089-abb6-4a0a-beaa-cd629d560bd6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:05.354862 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-e72a8089-abb6-4a0a-beaa-cd629d560bd6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] HTTP exception thrown: Instance 45bd7ced-496c-4b44-89db-ef9261de87cb could not be found. Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e72a8089-abb6-4a0a-beaa-cd629d560bd6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Request method failure captured: Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb HTTP/1.1 Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54LvrtpfaCL9P9k1Bk_AiY4eErWxnOvE0oDE7dlwrLn9wQZvcqibgjdM5Kz4Fzv3kVr5OOHWEjkGN4PUUL3mFxG36qc82kEqmeS2uEPal1YDuwlSveEBPMcmP0T2CjuPX63sobO8MndP-JSEVyeDj17PiF40ULG5zPNJ0q6zpmz4CSM Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: a5b0cb87dfc4461e9911c7e62b6ab959 Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-VolumesActionsTest-736259158 Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:39:05.356510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5b0cb87dfc4461e9911c7e62b6ab959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a5b0cb87dfc4461e9911c7e62b6ab959"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5b0cb87dfc4461e9911c7e62b6ab959"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a5b0cb87dfc4461e9911c7e62b6ab959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-VolumesActionsTest-736259158 Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: a5b0cb87dfc4461e9911c7e62b6ab959 Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-VolumesActionsTest-736259158 Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-VolumesActionsTest-736259158-project Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 9255edea8b504727a587443e124f3e7a Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-VolumesActionsTest-736259158-project Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 45bd7ced-496c-4b44-89db-ef9261de87cb could not be found. Aug 01 07:39:05.357990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '45bd7ced-496c-4b44-89db-ef9261de87cb'} Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bd7ced-496c-4b44-89db-ef9261de87cb could not be found. Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:39:05.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bd7ced-496c-4b44-89db-ef9261de87cb could not be found. Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bd7ced-496c-4b44-89db-ef9261de87cb could not be found. Aug 01 07:39:05.360210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:39:05.362032 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e72a8089-abb6-4a0a-beaa-cd629d560bd6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] Returning 404 to user: Instance 45bd7ced-496c-4b44-89db-ef9261de87cb could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:39:05.362032 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e72a8089-abb6-4a0a-beaa-cd629d560bd6 tempest-VolumesActionsTest-736259158 tempest-VolumesActionsTest-736259158-project] 10.222.0.40 "GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb" status: 404 len: 111 microversion: 2.1 time: 0.029870 Aug 01 07:39:05.362032 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 135/263] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:05 2022] GET /compute/v2.1/servers/45bd7ced-496c-4b44-89db-ef9261de87cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:39:05.407531 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-bbdfd8d4-9dcf-4396-b843-bdf3f0623131 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:05.408317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-bbdfd8d4-9dcf-4396-b843-bdf3f0623131 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:05.414308 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bbdfd8d4-9dcf-4396-b843-bdf3f0623131 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:05.414755 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bbdfd8d4-9dcf-4396-b843-bdf3f0623131 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:05.415538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bbdfd8d4-9dcf-4396-b843-bdf3f0623131 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:05.415973 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bbdfd8d4-9dcf-4396-b843-bdf3f0623131 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:05.559410 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-bbdfd8d4-9dcf-4396-b843-bdf3f0623131 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:05.566898 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-bbdfd8d4-9dcf-4396-b843-bdf3f0623131 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.163094 Aug 01 07:39:05.567816 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 129/264] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:05 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:06.588922 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ba99457b-ebe4-4f6c-b21d-41ba4525a1c6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:06.589510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ba99457b-ebe4-4f6c-b21d-41ba4525a1c6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:06.596423 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba99457b-ebe4-4f6c-b21d-41ba4525a1c6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:06.596875 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba99457b-ebe4-4f6c-b21d-41ba4525a1c6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:06.597651 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba99457b-ebe4-4f6c-b21d-41ba4525a1c6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:06.598081 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba99457b-ebe4-4f6c-b21d-41ba4525a1c6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:06.732184 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ba99457b-ebe4-4f6c-b21d-41ba4525a1c6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:06.740319 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ba99457b-ebe4-4f6c-b21d-41ba4525a1c6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.155260 Aug 01 07:39:06.740886 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 136/265] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:06 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:07.761792 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-89e97455-d024-481f-8d6b-f82ba9d53fcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:07.762329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-89e97455-d024-481f-8d6b-f82ba9d53fcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:07.768510 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-89e97455-d024-481f-8d6b-f82ba9d53fcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:07.768961 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-89e97455-d024-481f-8d6b-f82ba9d53fcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:07.769717 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-89e97455-d024-481f-8d6b-f82ba9d53fcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:07.770152 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-89e97455-d024-481f-8d6b-f82ba9d53fcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:07.906700 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-89e97455-d024-481f-8d6b-f82ba9d53fcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:07.915015 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-89e97455-d024-481f-8d6b-f82ba9d53fcc tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.157179 Aug 01 07:39:07.915599 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 130/266] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:07 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:08.136451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3deb7944-8c33-42bf-bbe5-8de05c6b8ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:08.136985 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3deb7944-8c33-42bf-bbe5-8de05c6b8ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:08.144354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3deb7944-8c33-42bf-bbe5-8de05c6b8ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:08.144814 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3deb7944-8c33-42bf-bbe5-8de05c6b8ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:08.145586 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3deb7944-8c33-42bf-bbe5-8de05c6b8ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:08.146029 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3deb7944-8c33-42bf-bbe5-8de05c6b8ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:08.169053 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3deb7944-8c33-42bf-bbe5-8de05c6b8ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/ips" status: 200 len: 146 microversion: 2.1 time: 0.036596 Aug 01 07:39:08.169615 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 137/267] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 1 07:39:08 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:39:08.936045 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-baed828d-addd-4f0a-8653-23a2b2ff0557 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:08.936649 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-baed828d-addd-4f0a-8653-23a2b2ff0557 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:08.938687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:08.943946 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-baed828d-addd-4f0a-8653-23a2b2ff0557 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:08.944394 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-baed828d-addd-4f0a-8653-23a2b2ff0557 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:08.945145 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-baed828d-addd-4f0a-8653-23a2b2ff0557 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:08.945581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-baed828d-addd-4f0a-8653-23a2b2ff0557 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:09.086148 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-baed828d-addd-4f0a-8653-23a2b2ff0557 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:09.094584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-baed828d-addd-4f0a-8653-23a2b2ff0557 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.162334 Aug 01 07:39:09.108495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 131/268] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:08 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:10.118333 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1d37f454-166f-4d5e-90fa-4847001385a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:10.119606 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1d37f454-166f-4d5e-90fa-4847001385a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:10.126639 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d37f454-166f-4d5e-90fa-4847001385a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:10.127710 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d37f454-166f-4d5e-90fa-4847001385a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:10.129131 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d37f454-166f-4d5e-90fa-4847001385a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:10.129719 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d37f454-166f-4d5e-90fa-4847001385a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:10.290310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1d37f454-166f-4d5e-90fa-4847001385a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:10.298044 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1d37f454-166f-4d5e-90fa-4847001385a9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.185038 Aug 01 07:39:10.298682 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 138/269] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:10 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:10.437279 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-84a6be01-d5d6-4a46-8489-55197bba5f48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:10.437880 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-84a6be01-d5d6-4a46-8489-55197bba5f48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:10.444074 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-84a6be01-d5d6-4a46-8489-55197bba5f48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:10.444600 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-84a6be01-d5d6-4a46-8489-55197bba5f48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:10.445450 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-84a6be01-d5d6-4a46-8489-55197bba5f48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:10.445958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-84a6be01-d5d6-4a46-8489-55197bba5f48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:10.449660 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:10.469205 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-84a6be01-d5d6-4a46-8489-55197bba5f48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lazy-loading 'flavor' on Instance uuid 8ff143cc-5a30-44be-a327-29eaacf61348 {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:39:11.316365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d9c9de6a-8be4-4935-b5b3-73bde6f96980 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67cfdef9-591b-47bc-b195-63c893a76959"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:11.318831 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d9c9de6a-8be4-4935-b5b3-73bde6f96980 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:11.325091 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d9c9de6a-8be4-4935-b5b3-73bde6f96980 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:11.325552 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d9c9de6a-8be4-4935-b5b3-73bde6f96980 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:11.326365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d9c9de6a-8be4-4935-b5b3-73bde6f96980 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:11.326810 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d9c9de6a-8be4-4935-b5b3-73bde6f96980 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:11.616508 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d9c9de6a-8be4-4935-b5b3-73bde6f96980 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304798 Aug 01 07:39:11.617718 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 139/270] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:39:11 2022] POST /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:39:11.623917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a3c97094-9c3c-4369-bb19-652b7d09f6e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:11.625193 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a3c97094-9c3c-4369-bb19-652b7d09f6e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:11.632584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a3c97094-9c3c-4369-bb19-652b7d09f6e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:11.633472 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a3c97094-9c3c-4369-bb19-652b7d09f6e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:11.634367 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a3c97094-9c3c-4369-bb19-652b7d09f6e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:11.635139 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a3c97094-9c3c-4369-bb19-652b7d09f6e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:11.797209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a3c97094-9c3c-4369-bb19-652b7d09f6e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:11.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a3c97094-9c3c-4369-bb19-652b7d09f6e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.188523 Aug 01 07:39:11.823957 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 140/271] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:11 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:11.957923 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-84a6be01-d5d6-4a46-8489-55197bba5f48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "POST /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/action" status: 202 len: 0 microversion: 2.20 time: 1.524640 Aug 01 07:39:11.960421 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 132/272] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Aug 1 07:39:10 2022] POST /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/action => generated 0 bytes in 1528 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:39:11.979111 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f074e4d5-c495-49a1-a82e-b73373c83b4f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:11.993142 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f074e4d5-c495-49a1-a82e-b73373c83b4f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:12.015759 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f074e4d5-c495-49a1-a82e-b73373c83b4f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:12.016664 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f074e4d5-c495-49a1-a82e-b73373c83b4f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:12.017581 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f074e4d5-c495-49a1-a82e-b73373c83b4f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:12.018118 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f074e4d5-c495-49a1-a82e-b73373c83b4f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:12.167340 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f074e4d5-c495-49a1-a82e-b73373c83b4f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:12.176306 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f074e4d5-c495-49a1-a82e-b73373c83b4f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:12.177806 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f074e4d5-c495-49a1-a82e-b73373c83b4f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:12.178959 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f074e4d5-c495-49a1-a82e-b73373c83b4f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.213366 Aug 01 07:39:12.179535 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 141/273] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:11 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:12.834218 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c9e06ebe-f6a3-4b67-8183-b6fa09eaebaa tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:12.835397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c9e06ebe-f6a3-4b67-8183-b6fa09eaebaa tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:12.842946 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c9e06ebe-f6a3-4b67-8183-b6fa09eaebaa tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:12.843737 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c9e06ebe-f6a3-4b67-8183-b6fa09eaebaa tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:12.844603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c9e06ebe-f6a3-4b67-8183-b6fa09eaebaa tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:12.845368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c9e06ebe-f6a3-4b67-8183-b6fa09eaebaa tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:13.051288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c9e06ebe-f6a3-4b67-8183-b6fa09eaebaa tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:13.065974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c9e06ebe-f6a3-4b67-8183-b6fa09eaebaa tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.236205 Aug 01 07:39:13.066590 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 133/274] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:12 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:13.201651 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5efd7586-82da-48b3-a142-dfa5a9012ff8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:13.202897 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5efd7586-82da-48b3-a142-dfa5a9012ff8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:13.209865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5efd7586-82da-48b3-a142-dfa5a9012ff8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:13.210295 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5efd7586-82da-48b3-a142-dfa5a9012ff8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:13.211103 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5efd7586-82da-48b3-a142-dfa5a9012ff8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:13.211533 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5efd7586-82da-48b3-a142-dfa5a9012ff8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:13.380339 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5efd7586-82da-48b3-a142-dfa5a9012ff8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:13.391280 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5efd7586-82da-48b3-a142-dfa5a9012ff8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:13.393989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5efd7586-82da-48b3-a142-dfa5a9012ff8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:13.395372 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5efd7586-82da-48b3-a142-dfa5a9012ff8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.197534 Aug 01 07:39:13.411106 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 142/275] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:13 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:14.091938 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ac2725fe-c184-4353-ae06-f11bc73e7331 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:14.093481 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ac2725fe-c184-4353-ae06-f11bc73e7331 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:14.102278 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ac2725fe-c184-4353-ae06-f11bc73e7331 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:14.103183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ac2725fe-c184-4353-ae06-f11bc73e7331 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:14.104777 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ac2725fe-c184-4353-ae06-f11bc73e7331 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:14.105446 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ac2725fe-c184-4353-ae06-f11bc73e7331 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:14.249790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ac2725fe-c184-4353-ae06-f11bc73e7331 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:14.258597 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ac2725fe-c184-4353-ae06-f11bc73e7331 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.174811 Aug 01 07:39:14.271613 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 134/276] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:14 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:14.420481 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9ca10f69-198a-4f72-a230-2e646474a2d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:14.421697 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9ca10f69-198a-4f72-a230-2e646474a2d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:14.433800 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9ca10f69-198a-4f72-a230-2e646474a2d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:14.434257 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9ca10f69-198a-4f72-a230-2e646474a2d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:14.435133 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9ca10f69-198a-4f72-a230-2e646474a2d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:14.435574 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9ca10f69-198a-4f72-a230-2e646474a2d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:14.594423 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9ca10f69-198a-4f72-a230-2e646474a2d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:14.603338 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9ca10f69-198a-4f72-a230-2e646474a2d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:14.604930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9ca10f69-198a-4f72-a230-2e646474a2d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:14.606098 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9ca10f69-198a-4f72-a230-2e646474a2d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.190677 Aug 01 07:39:14.607166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 143/277] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:14 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:15.279425 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5639048a-2bac-46ae-bb82-e6ca686fa464 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:15.280570 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5639048a-2bac-46ae-bb82-e6ca686fa464 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:15.288349 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5639048a-2bac-46ae-bb82-e6ca686fa464 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:15.288953 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5639048a-2bac-46ae-bb82-e6ca686fa464 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:15.289877 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5639048a-2bac-46ae-bb82-e6ca686fa464 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:15.290468 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5639048a-2bac-46ae-bb82-e6ca686fa464 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:15.543190 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5639048a-2bac-46ae-bb82-e6ca686fa464 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:15.551617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5639048a-2bac-46ae-bb82-e6ca686fa464 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.276061 Aug 01 07:39:15.552513 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 135/278] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:15 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:15.632599 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e85faad6-d09a-4796-845e-5b0370bbeafb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:15.633211 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e85faad6-d09a-4796-845e-5b0370bbeafb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:15.640402 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e85faad6-d09a-4796-845e-5b0370bbeafb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:15.640988 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e85faad6-d09a-4796-845e-5b0370bbeafb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:15.641830 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e85faad6-d09a-4796-845e-5b0370bbeafb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:15.642275 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e85faad6-d09a-4796-845e-5b0370bbeafb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:15.824135 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e85faad6-d09a-4796-845e-5b0370bbeafb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:15.833138 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e85faad6-d09a-4796-845e-5b0370bbeafb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:15.834657 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e85faad6-d09a-4796-845e-5b0370bbeafb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:15.835854 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e85faad6-d09a-4796-845e-5b0370bbeafb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.207875 Aug 01 07:39:15.836415 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 144/279] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:15 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:39:16.573359 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0a50dd46-a24d-4a49-a677-c1fd9a48242c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:16.574043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0a50dd46-a24d-4a49-a677-c1fd9a48242c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:16.580583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a50dd46-a24d-4a49-a677-c1fd9a48242c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:16.581196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a50dd46-a24d-4a49-a677-c1fd9a48242c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:16.581974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a50dd46-a24d-4a49-a677-c1fd9a48242c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:16.582412 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a50dd46-a24d-4a49-a677-c1fd9a48242c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:16.723958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0a50dd46-a24d-4a49-a677-c1fd9a48242c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:16.732822 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0a50dd46-a24d-4a49-a677-c1fd9a48242c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.163341 Aug 01 07:39:16.733870 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 136/280] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:16 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:16.867682 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-903afd20-1ead-4b84-8283-d1d79cdc1301 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:16.867682 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-903afd20-1ead-4b84-8283-d1d79cdc1301 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:16.869969 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:16.875763 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-903afd20-1ead-4b84-8283-d1d79cdc1301 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:16.876209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-903afd20-1ead-4b84-8283-d1d79cdc1301 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:16.877171 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-903afd20-1ead-4b84-8283-d1d79cdc1301 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:16.878274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-903afd20-1ead-4b84-8283-d1d79cdc1301 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:17.035456 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-903afd20-1ead-4b84-8283-d1d79cdc1301 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:17.043622 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-903afd20-1ead-4b84-8283-d1d79cdc1301 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:17.045142 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-903afd20-1ead-4b84-8283-d1d79cdc1301 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:17.046318 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-903afd20-1ead-4b84-8283-d1d79cdc1301 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.183650 Aug 01 07:39:17.046875 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 145/281] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:16 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:17.758669 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1be26896-5e88-41bc-aec7-d007e04f7d95 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:17.759251 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1be26896-5e88-41bc-aec7-d007e04f7d95 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:17.775092 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1be26896-5e88-41bc-aec7-d007e04f7d95 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:17.775564 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1be26896-5e88-41bc-aec7-d007e04f7d95 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:17.776552 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1be26896-5e88-41bc-aec7-d007e04f7d95 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:17.777201 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1be26896-5e88-41bc-aec7-d007e04f7d95 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:17.962104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1be26896-5e88-41bc-aec7-d007e04f7d95 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:17.974734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1be26896-5e88-41bc-aec7-d007e04f7d95 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.221119 Aug 01 07:39:17.975955 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 137/282] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:17 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:18.073273 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-31c3e86d-83fb-42a5-8019-f723f0ec7326 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:18.073879 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-31c3e86d-83fb-42a5-8019-f723f0ec7326 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:18.080358 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31c3e86d-83fb-42a5-8019-f723f0ec7326 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:18.080814 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31c3e86d-83fb-42a5-8019-f723f0ec7326 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:18.081776 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31c3e86d-83fb-42a5-8019-f723f0ec7326 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:18.082217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31c3e86d-83fb-42a5-8019-f723f0ec7326 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:18.431689 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-31c3e86d-83fb-42a5-8019-f723f0ec7326 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:18.440890 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-31c3e86d-83fb-42a5-8019-f723f0ec7326 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:18.442718 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-31c3e86d-83fb-42a5-8019-f723f0ec7326 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:18.444112 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-31c3e86d-83fb-42a5-8019-f723f0ec7326 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.375220 Aug 01 07:39:18.444827 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 146/283] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:18 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:39:18.999379 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d152d65e-ba89-48b9-959f-dbfb9bb00619 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:19.000318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d152d65e-ba89-48b9-959f-dbfb9bb00619 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:19.013008 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d152d65e-ba89-48b9-959f-dbfb9bb00619 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:19.013456 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d152d65e-ba89-48b9-959f-dbfb9bb00619 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:19.015319 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d152d65e-ba89-48b9-959f-dbfb9bb00619 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:19.016337 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d152d65e-ba89-48b9-959f-dbfb9bb00619 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:19.194863 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d152d65e-ba89-48b9-959f-dbfb9bb00619 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:19.208360 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d152d65e-ba89-48b9-959f-dbfb9bb00619 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.213377 Aug 01 07:39:19.223961 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 138/284] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:18 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:19.471159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-31d160fb-c362-4aeb-8738-a7d629302a85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:19.472718 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-31d160fb-c362-4aeb-8738-a7d629302a85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:19.481357 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31d160fb-c362-4aeb-8738-a7d629302a85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:19.481876 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31d160fb-c362-4aeb-8738-a7d629302a85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:19.482788 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31d160fb-c362-4aeb-8738-a7d629302a85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:19.483214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31d160fb-c362-4aeb-8738-a7d629302a85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:19.691417 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-31d160fb-c362-4aeb-8738-a7d629302a85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:19.707281 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-31d160fb-c362-4aeb-8738-a7d629302a85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:19.708991 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-31d160fb-c362-4aeb-8738-a7d629302a85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:19.710246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-31d160fb-c362-4aeb-8738-a7d629302a85 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.244333 Aug 01 07:39:19.711037 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 147/285] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:19 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:39:20.229837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c00f9449-ddd4-487e-89db-6497f18b1fd0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:20.230934 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c00f9449-ddd4-487e-89db-6497f18b1fd0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:20.238761 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c00f9449-ddd4-487e-89db-6497f18b1fd0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:20.239248 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c00f9449-ddd4-487e-89db-6497f18b1fd0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:20.240031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c00f9449-ddd4-487e-89db-6497f18b1fd0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:20.240467 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c00f9449-ddd4-487e-89db-6497f18b1fd0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:20.457481 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c00f9449-ddd4-487e-89db-6497f18b1fd0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:20.467988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c00f9449-ddd4-487e-89db-6497f18b1fd0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.242119 Aug 01 07:39:20.469293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 139/286] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:20 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:20.749136 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-cff68427-794c-4cf6-8bfe-f67a9498f3bb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:20.750969 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-cff68427-794c-4cf6-8bfe-f67a9498f3bb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:20.785234 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cff68427-794c-4cf6-8bfe-f67a9498f3bb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:20.787860 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cff68427-794c-4cf6-8bfe-f67a9498f3bb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:20.791545 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cff68427-794c-4cf6-8bfe-f67a9498f3bb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:20.792232 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cff68427-794c-4cf6-8bfe-f67a9498f3bb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:20.862997 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-874083407", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1321786183", "security_groups": [{"name": "tempest-secgroup-smoke-1232814588"}], "networks": [{"uuid": "ef3d3ee4-0519-41a6-81b5-1adcab0e73ed"}], "block_device_mapping_v2": [{"uuid": "0361ab93-6684-4743-8f71-e24a5d24f347", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:21.061990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-cff68427-794c-4cf6-8bfe-f67a9498f3bb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:21.074861 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-cff68427-794c-4cf6-8bfe-f67a9498f3bb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:21.076740 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-cff68427-794c-4cf6-8bfe-f67a9498f3bb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:21.078203 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-cff68427-794c-4cf6-8bfe-f67a9498f3bb tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.345834 Aug 01 07:39:21.089228 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 148/287] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:20 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:21.109599 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] validate_networks() for [('ef3d3ee4-0519-41a6-81b5-1adcab0e73ed', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:39:21.499975 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-da733afb-cb4f-41e2-a1c0-cff6b64972c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:21.501417 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-da733afb-cb4f-41e2-a1c0-cff6b64972c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:21.515884 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-da733afb-cb4f-41e2-a1c0-cff6b64972c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:21.517927 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-da733afb-cb4f-41e2-a1c0-cff6b64972c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:21.520249 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-da733afb-cb4f-41e2-a1c0-cff6b64972c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:21.520845 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-da733afb-cb4f-41e2-a1c0-cff6b64972c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:21.842065 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-da733afb-cb4f-41e2-a1c0-cff6b64972c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:21.851940 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-da733afb-cb4f-41e2-a1c0-cff6b64972c1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.358719 Aug 01 07:39:21.854403 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 149/288] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:21 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:21.895944 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:39:21.897146 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:39:21.897955 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:39:21.898897 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:39:21.899414 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:39:21.927790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:21.928450 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:21.933213 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:21.933911 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:21.968697 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Getting quotas for project f07c6f16ad7747c5a42b4d0351a44545. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:39:21.975050 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Getting quotas for user d714badcdf8e4461ae1f7ebe4f0c82d4 and project f07c6f16ad7747c5a42b4d0351a44545. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:39:22.095982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:39:22.098482 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0361ab93-6684-4743-8f71-e24a5d24f347',volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:39:22.107011 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e6cc4934-f7d2-4981-9859-ab67694bdcd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:22.108025 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e6cc4934-f7d2-4981-9859-ab67694bdcd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:22.151174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e6cc4934-f7d2-4981-9859-ab67694bdcd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:22.151174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e6cc4934-f7d2-4981-9859-ab67694bdcd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:22.151174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e6cc4934-f7d2-4981-9859-ab67694bdcd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:22.151174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e6cc4934-f7d2-4981-9859-ab67694bdcd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:22.215114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:22.324340 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0055cb16-5b42-4280-bc36-0cfa656247a1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.471462 Aug 01 07:39:22.326135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 140/289] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:39:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 07:39:22.339097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f2435392-ba3d-47d3-b2b3-3c9f9e7b7453 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:22.339721 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f2435392-ba3d-47d3-b2b3-3c9f9e7b7453 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:22.466375 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f2435392-ba3d-47d3-b2b3-3c9f9e7b7453 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:22.475803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f2435392-ba3d-47d3-b2b3-3c9f9e7b7453 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1088 microversion: 2.1 time: 0.140470 Aug 01 07:39:22.476664 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 141/290] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:22 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1088 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:22.548368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e6cc4934-f7d2-4981-9859-ab67694bdcd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:22.571411 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e6cc4934-f7d2-4981-9859-ab67694bdcd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:22.576809 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e6cc4934-f7d2-4981-9859-ab67694bdcd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:22.581367 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e6cc4934-f7d2-4981-9859-ab67694bdcd8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.477548 Aug 01 07:39:22.584202 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 150/291] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:22 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:39:22.880740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-dac2e1c9-6692-4109-bebd-88aa89388207 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:22.880740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-dac2e1c9-6692-4109-bebd-88aa89388207 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:22.889741 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dac2e1c9-6692-4109-bebd-88aa89388207 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:22.890221 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dac2e1c9-6692-4109-bebd-88aa89388207 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:22.891025 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dac2e1c9-6692-4109-bebd-88aa89388207 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:22.891516 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dac2e1c9-6692-4109-bebd-88aa89388207 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:23.180793 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-dac2e1c9-6692-4109-bebd-88aa89388207 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:23.193828 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-dac2e1c9-6692-4109-bebd-88aa89388207 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.320286 Aug 01 07:39:23.196328 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 142/292] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:22 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:23.505538 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6b161e0b-2f70-48db-ab1f-0ebf329871f8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:23.511805 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6b161e0b-2f70-48db-ab1f-0ebf329871f8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:23.522864 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b161e0b-2f70-48db-ab1f-0ebf329871f8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:23.523715 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b161e0b-2f70-48db-ab1f-0ebf329871f8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:23.525059 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b161e0b-2f70-48db-ab1f-0ebf329871f8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:23.525742 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b161e0b-2f70-48db-ab1f-0ebf329871f8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:23.607025 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1b5cf03b-55cf-41ed-8d5e-d1a8e1a829f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:23.607726 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1b5cf03b-55cf-41ed-8d5e-d1a8e1a829f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:23.615987 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b5cf03b-55cf-41ed-8d5e-d1a8e1a829f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:23.616448 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b5cf03b-55cf-41ed-8d5e-d1a8e1a829f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:23.620613 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b5cf03b-55cf-41ed-8d5e-d1a8e1a829f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:23.622157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b5cf03b-55cf-41ed-8d5e-d1a8e1a829f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:23.633468 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6b161e0b-2f70-48db-ab1f-0ebf329871f8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:23.654870 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6b161e0b-2f70-48db-ab1f-0ebf329871f8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1186 microversion: 2.1 time: 0.158819 Aug 01 07:39:23.672075 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 151/293] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:23 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1186 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:23.875430 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1b5cf03b-55cf-41ed-8d5e-d1a8e1a829f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:23.905109 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1b5cf03b-55cf-41ed-8d5e-d1a8e1a829f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:23.909828 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1b5cf03b-55cf-41ed-8d5e-d1a8e1a829f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:23.915225 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1b5cf03b-55cf-41ed-8d5e-d1a8e1a829f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.312887 Aug 01 07:39:23.917081 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 143/294] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:23 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:23.963398 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2a9ec41c-157a-4656-a532-8b600d88c097 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:23.973300 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2a9ec41c-157a-4656-a532-8b600d88c097 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:23.975624 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2a9ec41c-157a-4656-a532-8b600d88c097 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:24.074725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2a9ec41c-157a-4656-a532-8b600d88c097 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Going to try to stop instance {{(pid=124279) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 07:39:24.201923 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2a9ec41c-157a-4656-a532-8b600d88c097 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/action" status: 202 len: 0 microversion: 2.1 time: 0.239343 Aug 01 07:39:24.204196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 152/295] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:39:23 2022] POST /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 07:39:24.214243 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-47408d47-e314-4e3d-a3de-e6ddd2e785bc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:24.216856 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-47408d47-e314-4e3d-a3de-e6ddd2e785bc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:24.233502 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-59ca7f33-d216-41d0-9b12-2283c4673d84 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:24.235575 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-59ca7f33-d216-41d0-9b12-2283c4673d84 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:24.242496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-47408d47-e314-4e3d-a3de-e6ddd2e785bc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:24.243775 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-47408d47-e314-4e3d-a3de-e6ddd2e785bc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:24.246819 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-47408d47-e314-4e3d-a3de-e6ddd2e785bc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:24.247723 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-47408d47-e314-4e3d-a3de-e6ddd2e785bc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:24.257485 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-59ca7f33-d216-41d0-9b12-2283c4673d84 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:24.258056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-59ca7f33-d216-41d0-9b12-2283c4673d84 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:24.259144 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-59ca7f33-d216-41d0-9b12-2283c4673d84 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:24.259841 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-59ca7f33-d216-41d0-9b12-2283c4673d84 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:24.591527 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-59ca7f33-d216-41d0-9b12-2283c4673d84 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:24.606422 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-59ca7f33-d216-41d0-9b12-2283c4673d84 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.389960 Aug 01 07:39:24.616375 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 153/296] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:24 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:24.683834 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4daa8f16-05fc-499f-825a-032063e73027 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:24.684462 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4daa8f16-05fc-499f-825a-032063e73027 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:24.693264 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4daa8f16-05fc-499f-825a-032063e73027 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:24.694231 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4daa8f16-05fc-499f-825a-032063e73027 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:24.695875 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4daa8f16-05fc-499f-825a-032063e73027 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:24.696491 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4daa8f16-05fc-499f-825a-032063e73027 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:24.813222 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4daa8f16-05fc-499f-825a-032063e73027 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:24.829639 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4daa8f16-05fc-499f-825a-032063e73027 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1204 microversion: 2.1 time: 0.153770 Aug 01 07:39:24.847572 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 154/297] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:24 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1204 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:24.944724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-971136d4-3b66-4fe7-99fe-256fe32995c8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:24.946282 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-971136d4-3b66-4fe7-99fe-256fe32995c8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:24.963852 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-971136d4-3b66-4fe7-99fe-256fe32995c8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:24.964475 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-971136d4-3b66-4fe7-99fe-256fe32995c8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:24.968581 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-971136d4-3b66-4fe7-99fe-256fe32995c8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:24.971125 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-971136d4-3b66-4fe7-99fe-256fe32995c8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:25.163888 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-971136d4-3b66-4fe7-99fe-256fe32995c8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:25.175449 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-971136d4-3b66-4fe7-99fe-256fe32995c8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:25.177900 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-971136d4-3b66-4fe7-99fe-256fe32995c8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:25.179421 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-971136d4-3b66-4fe7-99fe-256fe32995c8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.241026 Aug 01 07:39:25.180181 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 155/298] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:24 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:25.195878 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-47408d47-e314-4e3d-a3de-e6ddd2e785bc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:25.212421 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-47408d47-e314-4e3d-a3de-e6ddd2e785bc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 1.002827 Aug 01 07:39:25.213393 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 144/299] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:24 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:25.632924 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-253ca262-c81d-4dea-a6f5-9b47d08099e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:25.633524 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-253ca262-c81d-4dea-a6f5-9b47d08099e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:25.659721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-253ca262-c81d-4dea-a6f5-9b47d08099e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:25.660210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-253ca262-c81d-4dea-a6f5-9b47d08099e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:25.661516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-253ca262-c81d-4dea-a6f5-9b47d08099e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:25.662288 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-253ca262-c81d-4dea-a6f5-9b47d08099e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:25.853812 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-370d56c0-e716-4e1c-844e-56160b95aa3f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:25.854488 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-370d56c0-e716-4e1c-844e-56160b95aa3f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:25.872382 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-370d56c0-e716-4e1c-844e-56160b95aa3f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:25.875270 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-370d56c0-e716-4e1c-844e-56160b95aa3f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:25.880407 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-370d56c0-e716-4e1c-844e-56160b95aa3f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:25.882563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-370d56c0-e716-4e1c-844e-56160b95aa3f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:25.915383 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-253ca262-c81d-4dea-a6f5-9b47d08099e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:25.929338 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-253ca262-c81d-4dea-a6f5-9b47d08099e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.300004 Aug 01 07:39:25.930865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 156/300] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:25 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:26.219112 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7720c43f-a644-4641-a882-c23fdae88e58 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:26.220079 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7720c43f-a644-4641-a882-c23fdae88e58 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:26.238839 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7720c43f-a644-4641-a882-c23fdae88e58 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:26.239612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7720c43f-a644-4641-a882-c23fdae88e58 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:26.247963 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7720c43f-a644-4641-a882-c23fdae88e58 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:26.248441 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7720c43f-a644-4641-a882-c23fdae88e58 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:26.286808 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-370d56c0-e716-4e1c-844e-56160b95aa3f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:26.307575 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-370d56c0-e716-4e1c-844e-56160b95aa3f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.459098 Aug 01 07:39:26.308507 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 145/301] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:25 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:26.326603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-da94d8fd-58b4-433d-a70d-59dae51aa3f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:26.328580 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-da94d8fd-58b4-433d-a70d-59dae51aa3f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:26.351686 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da94d8fd-58b4-433d-a70d-59dae51aa3f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:26.357590 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da94d8fd-58b4-433d-a70d-59dae51aa3f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:26.358672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da94d8fd-58b4-433d-a70d-59dae51aa3f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:26.359293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da94d8fd-58b4-433d-a70d-59dae51aa3f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:26.561777 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7720c43f-a644-4641-a882-c23fdae88e58 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:26.574351 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7720c43f-a644-4641-a882-c23fdae88e58 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:26.582110 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7720c43f-a644-4641-a882-c23fdae88e58 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:26.583525 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7720c43f-a644-4641-a882-c23fdae88e58 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.376062 Aug 01 07:39:26.586276 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 157/302] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:26 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:26.810756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-da94d8fd-58b4-433d-a70d-59dae51aa3f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:26.821659 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-da94d8fd-58b4-433d-a70d-59dae51aa3f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.511765 Aug 01 07:39:26.822507 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 146/303] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:26 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:26.958702 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a2b77622-6fc5-4939-a658-57252d16ab1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:26.959541 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a2b77622-6fc5-4939-a658-57252d16ab1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:26.975504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a2b77622-6fc5-4939-a658-57252d16ab1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:26.976659 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a2b77622-6fc5-4939-a658-57252d16ab1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:26.978403 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a2b77622-6fc5-4939-a658-57252d16ab1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:26.979698 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a2b77622-6fc5-4939-a658-57252d16ab1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:27.211546 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a2b77622-6fc5-4939-a658-57252d16ab1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:27.221145 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a2b77622-6fc5-4939-a658-57252d16ab1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.266215 Aug 01 07:39:27.234491 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 158/304] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:26 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:27.321235 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-d37dc554-3e6b-4e88-86af-577015fc7042 req-f8005ef3-4943-4dd9-ac58-b6c8c0c207bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b28df3b-0e7f-425f-9e11-c2e34a32f31e", "tag": "8385f662-a544-477f-910d-b785d83e699e"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:27.330840 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0e043188-40ec-498b-8008-4d15a3363aa7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:27.331150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0e043188-40ec-498b-8008-4d15a3363aa7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:27.337993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-d37dc554-3e6b-4e88-86af-577015fc7042 req-f8005ef3-4943-4dd9-ac58-b6c8c0c207bf service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:27.339510 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-d37dc554-3e6b-4e88-86af-577015fc7042 req-f8005ef3-4943-4dd9-ac58-b6c8c0c207bf service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:27.360864 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-d37dc554-3e6b-4e88-86af-577015fc7042 req-f8005ef3-4943-4dd9-ac58-b6c8c0c207bf service nova] Creating event network-changed:8385f662-a544-477f-910d-b785d83e699e for instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e on hv-cinder-73306 Aug 01 07:39:27.361086 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e043188-40ec-498b-8008-4d15a3363aa7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:27.361511 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e043188-40ec-498b-8008-4d15a3363aa7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:27.363201 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e043188-40ec-498b-8008-4d15a3363aa7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:27.363668 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e043188-40ec-498b-8008-4d15a3363aa7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:27.366991 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-d37dc554-3e6b-4e88-86af-577015fc7042 req-f8005ef3-4943-4dd9-ac58-b6c8c0c207bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052841 Aug 01 07:39:27.367933 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 147/305] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:39:27.620711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f573ebe8-7305-44c0-a50a-cccaafb44ba8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:27.621552 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f573ebe8-7305-44c0-a50a-cccaafb44ba8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:27.673017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f573ebe8-7305-44c0-a50a-cccaafb44ba8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:27.674380 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f573ebe8-7305-44c0-a50a-cccaafb44ba8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:27.675452 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f573ebe8-7305-44c0-a50a-cccaafb44ba8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:27.676098 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f573ebe8-7305-44c0-a50a-cccaafb44ba8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:27.912320 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0e043188-40ec-498b-8008-4d15a3363aa7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:27.929760 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0e043188-40ec-498b-8008-4d15a3363aa7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.604012 Aug 01 07:39:27.933446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 159/306] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:27 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:27.992456 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d3651fa6-d64b-4a68-89e5-ab6588033c19 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:27.996804 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d3651fa6-d64b-4a68-89e5-ab6588033c19 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:28.028334 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d3651fa6-d64b-4a68-89e5-ab6588033c19 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:28.030385 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d3651fa6-d64b-4a68-89e5-ab6588033c19 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:28.033014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d3651fa6-d64b-4a68-89e5-ab6588033c19 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:28.034474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d3651fa6-d64b-4a68-89e5-ab6588033c19 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:28.132193 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f573ebe8-7305-44c0-a50a-cccaafb44ba8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:28.143031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f573ebe8-7305-44c0-a50a-cccaafb44ba8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:28.145106 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f573ebe8-7305-44c0-a50a-cccaafb44ba8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:28.146307 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f573ebe8-7305-44c0-a50a-cccaafb44ba8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.537881 Aug 01 07:39:28.147385 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 148/307] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:27 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:28.243857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-05171185-083f-44bb-beff-8efa2c33bf8b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:28.245249 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-05171185-083f-44bb-beff-8efa2c33bf8b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:28.256455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05171185-083f-44bb-beff-8efa2c33bf8b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:28.258158 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05171185-083f-44bb-beff-8efa2c33bf8b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:28.262737 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05171185-083f-44bb-beff-8efa2c33bf8b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:28.263418 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05171185-083f-44bb-beff-8efa2c33bf8b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:28.286163 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:28.306101 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d3651fa6-d64b-4a68-89e5-ab6588033c19 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:28.317341 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d3651fa6-d64b-4a68-89e5-ab6588033c19 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.381446 Aug 01 07:39:28.332012 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 160/308] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:27 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:28.461864 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-05171185-083f-44bb-beff-8efa2c33bf8b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:28.469427 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-05171185-083f-44bb-beff-8efa2c33bf8b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.230246 Aug 01 07:39:28.469983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 149/309] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:28 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:28.959221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-178af9e0-89ff-4d8f-91b3-6bc94ebc990d tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:28.959835 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-178af9e0-89ff-4d8f-91b3-6bc94ebc990d tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:28.981159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-178af9e0-89ff-4d8f-91b3-6bc94ebc990d tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:28.981892 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-178af9e0-89ff-4d8f-91b3-6bc94ebc990d tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:28.983110 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-178af9e0-89ff-4d8f-91b3-6bc94ebc990d tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:28.983709 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-178af9e0-89ff-4d8f-91b3-6bc94ebc990d tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:29.173717 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cfa21e04-d9f4-423e-9cbb-09395c0b8bb4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:29.174905 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-cfa21e04-d9f4-423e-9cbb-09395c0b8bb4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:29.195229 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cfa21e04-d9f4-423e-9cbb-09395c0b8bb4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:29.200869 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cfa21e04-d9f4-423e-9cbb-09395c0b8bb4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:29.202676 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cfa21e04-d9f4-423e-9cbb-09395c0b8bb4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:29.204102 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cfa21e04-d9f4-423e-9cbb-09395c0b8bb4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:29.212737 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-178af9e0-89ff-4d8f-91b3-6bc94ebc990d tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:29.223593 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-178af9e0-89ff-4d8f-91b3-6bc94ebc990d tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.269122 Aug 01 07:39:29.236907 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 161/310] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:28 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:29.343766 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-48de9589-5b09-4491-9870-117d33556089 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:29.346747 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-48de9589-5b09-4491-9870-117d33556089 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:29.362282 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-48de9589-5b09-4491-9870-117d33556089 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:29.363154 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-48de9589-5b09-4491-9870-117d33556089 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:29.364549 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-48de9589-5b09-4491-9870-117d33556089 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:29.365195 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-48de9589-5b09-4491-9870-117d33556089 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:29.461021 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-cfa21e04-d9f4-423e-9cbb-09395c0b8bb4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:29.470757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-cfa21e04-d9f4-423e-9cbb-09395c0b8bb4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:29.477101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-cfa21e04-d9f4-423e-9cbb-09395c0b8bb4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:29.478564 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-cfa21e04-d9f4-423e-9cbb-09395c0b8bb4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.308996 Aug 01 07:39:29.479918 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 150/311] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:29 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:29.503911 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-21b939c8-9a7e-4474-8e61-c5c7967ee4e7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:29.504929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-21b939c8-9a7e-4474-8e61-c5c7967ee4e7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:29.520537 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-21b939c8-9a7e-4474-8e61-c5c7967ee4e7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:29.521004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-21b939c8-9a7e-4474-8e61-c5c7967ee4e7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:29.521975 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-21b939c8-9a7e-4474-8e61-c5c7967ee4e7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:29.522207 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-21b939c8-9a7e-4474-8e61-c5c7967ee4e7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:29.578121 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-48de9589-5b09-4491-9870-117d33556089 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:29.591196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-48de9589-5b09-4491-9870-117d33556089 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.252691 Aug 01 07:39:29.592137 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 162/312] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:29 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:29.732747 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-21b939c8-9a7e-4474-8e61-c5c7967ee4e7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:29.749066 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-21b939c8-9a7e-4474-8e61-c5c7967ee4e7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.249802 Aug 01 07:39:29.750366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 151/313] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:29 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:30.246893 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-fdc94c0c-965e-4c29-b74f-dc869d6fbcc1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:30.247545 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-fdc94c0c-965e-4c29-b74f-dc869d6fbcc1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:30.257984 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fdc94c0c-965e-4c29-b74f-dc869d6fbcc1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:30.258929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fdc94c0c-965e-4c29-b74f-dc869d6fbcc1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:30.260496 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fdc94c0c-965e-4c29-b74f-dc869d6fbcc1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:30.261446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fdc94c0c-965e-4c29-b74f-dc869d6fbcc1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:30.513358 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0a163fee-e469-4276-93d4-68c018423fa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:30.515600 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0a163fee-e469-4276-93d4-68c018423fa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:30.524962 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a163fee-e469-4276-93d4-68c018423fa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:30.530603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a163fee-e469-4276-93d4-68c018423fa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:30.533747 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a163fee-e469-4276-93d4-68c018423fa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:30.535603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a163fee-e469-4276-93d4-68c018423fa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:30.589782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fdc94c0c-965e-4c29-b74f-dc869d6fbcc1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:30.606639 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-fdc94c0c-965e-4c29-b74f-dc869d6fbcc1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.364448 Aug 01 07:39:30.607794 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 163/314] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:30 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:30.634655 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-aa18e446-fba2-4850-b6db-ebbbfa4455cb tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:30.635825 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-aa18e446-fba2-4850-b6db-ebbbfa4455cb tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:30.644139 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa18e446-fba2-4850-b6db-ebbbfa4455cb tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:30.644726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa18e446-fba2-4850-b6db-ebbbfa4455cb tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:30.645868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa18e446-fba2-4850-b6db-ebbbfa4455cb tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:30.646618 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa18e446-fba2-4850-b6db-ebbbfa4455cb tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:30.787233 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0a163fee-e469-4276-93d4-68c018423fa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:30.808046 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0a163fee-e469-4276-93d4-68c018423fa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:30.814611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0a163fee-e469-4276-93d4-68c018423fa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:30.817264 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0a163fee-e469-4276-93d4-68c018423fa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.313678 Aug 01 07:39:30.818625 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 152/315] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:30 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:30.823980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f6176432-01e2-417e-8a48-8ef27e002115 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:30.824845 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f6176432-01e2-417e-8a48-8ef27e002115 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:30.832321 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f6176432-01e2-417e-8a48-8ef27e002115 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:30.833126 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f6176432-01e2-417e-8a48-8ef27e002115 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:30.835272 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f6176432-01e2-417e-8a48-8ef27e002115 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:30.835885 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f6176432-01e2-417e-8a48-8ef27e002115 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:30.893656 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-aa18e446-fba2-4850-b6db-ebbbfa4455cb tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:30.915935 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-aa18e446-fba2-4850-b6db-ebbbfa4455cb tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.301508 Aug 01 07:39:30.916525 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 164/316] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:30 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:31.074251 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f6176432-01e2-417e-8a48-8ef27e002115 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:31.083096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f6176432-01e2-417e-8a48-8ef27e002115 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.262862 Aug 01 07:39:31.083973 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 153/317] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:30 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:31.630308 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ba28f001-97b8-4b02-a128-1db86e8261a4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:31.631033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ba28f001-97b8-4b02-a128-1db86e8261a4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:31.641880 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba28f001-97b8-4b02-a128-1db86e8261a4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:31.642562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba28f001-97b8-4b02-a128-1db86e8261a4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:31.643533 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba28f001-97b8-4b02-a128-1db86e8261a4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:31.644076 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba28f001-97b8-4b02-a128-1db86e8261a4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:31.847893 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9b87d060-21b6-447f-a9eb-ee1f67ceb0e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:31.849226 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9b87d060-21b6-447f-a9eb-ee1f67ceb0e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:31.861562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b87d060-21b6-447f-a9eb-ee1f67ceb0e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:31.862040 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b87d060-21b6-447f-a9eb-ee1f67ceb0e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:31.865140 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b87d060-21b6-447f-a9eb-ee1f67ceb0e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:31.865615 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b87d060-21b6-447f-a9eb-ee1f67ceb0e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:31.900515 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ba28f001-97b8-4b02-a128-1db86e8261a4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:31.910576 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ba28f001-97b8-4b02-a128-1db86e8261a4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.284667 Aug 01 07:39:31.915799 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 165/318] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:31 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:31.941676 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:31.946467 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-05cc51f8-dc30-4b37-b325-a969f80ec4ce tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:31.947059 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-05cc51f8-dc30-4b37-b325-a969f80ec4ce tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:31.957592 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-05cc51f8-dc30-4b37-b325-a969f80ec4ce tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:31.958915 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-05cc51f8-dc30-4b37-b325-a969f80ec4ce tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:31.960375 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-05cc51f8-dc30-4b37-b325-a969f80ec4ce tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:31.964431 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-05cc51f8-dc30-4b37-b325-a969f80ec4ce tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:31.971794 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:32.119813 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9b87d060-21b6-447f-a9eb-ee1f67ceb0e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:32.135159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-05cc51f8-dc30-4b37-b325-a969f80ec4ce tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:32.140315 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9b87d060-21b6-447f-a9eb-ee1f67ceb0e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:32.142591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9b87d060-21b6-447f-a9eb-ee1f67ceb0e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:32.143974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9b87d060-21b6-447f-a9eb-ee1f67ceb0e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.301616 Aug 01 07:39:32.145742 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-05cc51f8-dc30-4b37-b325-a969f80ec4ce tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.204353 Aug 01 07:39:32.159738 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 166/319] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:31 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:32.165310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 154/320] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:31 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:39:32.165526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8fe62e38-7c7d-4c27-b56b-1ba0a288f771 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:32.166165 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8fe62e38-7c7d-4c27-b56b-1ba0a288f771 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:32.172592 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8fe62e38-7c7d-4c27-b56b-1ba0a288f771 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:32.173882 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8fe62e38-7c7d-4c27-b56b-1ba0a288f771 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:32.174794 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8fe62e38-7c7d-4c27-b56b-1ba0a288f771 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:32.175366 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8fe62e38-7c7d-4c27-b56b-1ba0a288f771 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:32.362145 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8fe62e38-7c7d-4c27-b56b-1ba0a288f771 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:32.372671 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8fe62e38-7c7d-4c27-b56b-1ba0a288f771 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.211430 Aug 01 07:39:32.376021 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 167/321] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:32 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:32.945704 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-096db416-c6ae-4a2c-9b12-1aa24fb36749 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:32.959567 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-096db416-c6ae-4a2c-9b12-1aa24fb36749 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:32.965066 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=8 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:32.968677 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-096db416-c6ae-4a2c-9b12-1aa24fb36749 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:32.971140 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-096db416-c6ae-4a2c-9b12-1aa24fb36749 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:32.971140 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-096db416-c6ae-4a2c-9b12-1aa24fb36749 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:32.971377 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-096db416-c6ae-4a2c-9b12-1aa24fb36749 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:33.159484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-096db416-c6ae-4a2c-9b12-1aa24fb36749 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:33.171517 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-096db416-c6ae-4a2c-9b12-1aa24fb36749 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.232327 Aug 01 07:39:33.172289 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9dc7a503-b63d-4330-b8a6-a41ff7f9681f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:33.172787 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9dc7a503-b63d-4330-b8a6-a41ff7f9681f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:33.173023 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 155/322] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:32 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:33.178642 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ab64ce9a-d271-4982-af2e-7967cb1428b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:33.179495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ab64ce9a-d271-4982-af2e-7967cb1428b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:33.186456 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ab64ce9a-d271-4982-af2e-7967cb1428b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:33.187190 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ab64ce9a-d271-4982-af2e-7967cb1428b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:33.188226 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ab64ce9a-d271-4982-af2e-7967cb1428b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:33.189536 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ab64ce9a-d271-4982-af2e-7967cb1428b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:33.197088 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9dc7a503-b63d-4330-b8a6-a41ff7f9681f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:33.199344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9dc7a503-b63d-4330-b8a6-a41ff7f9681f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:33.200830 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9dc7a503-b63d-4330-b8a6-a41ff7f9681f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:33.202618 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9dc7a503-b63d-4330-b8a6-a41ff7f9681f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:33.377531 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ab64ce9a-d271-4982-af2e-7967cb1428b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:33.387637 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ab64ce9a-d271-4982-af2e-7967cb1428b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:33.391361 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ab64ce9a-d271-4982-af2e-7967cb1428b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:33.393435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ab64ce9a-d271-4982-af2e-7967cb1428b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1744 microversion: 2.20 time: 0.218486 Aug 01 07:39:33.394599 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 156/323] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:33 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:33.399754 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-de562474-567b-42da-89aa-0391206cd3c4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:33.400639 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-de562474-567b-42da-89aa-0391206cd3c4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:33.409391 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-de562474-567b-42da-89aa-0391206cd3c4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:33.410090 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-de562474-567b-42da-89aa-0391206cd3c4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:33.411043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-de562474-567b-42da-89aa-0391206cd3c4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:33.411695 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-de562474-567b-42da-89aa-0391206cd3c4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:33.451554 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9dc7a503-b63d-4330-b8a6-a41ff7f9681f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:33.468185 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9dc7a503-b63d-4330-b8a6-a41ff7f9681f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.302784 Aug 01 07:39:33.469442 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 168/324] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:33 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:33.585057 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-de562474-567b-42da-89aa-0391206cd3c4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:33.593326 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-de562474-567b-42da-89aa-0391206cd3c4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.197339 Aug 01 07:39:33.593911 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 157/325] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:33 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:34.197084 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-06196486-6b86-4a6e-a8b3-20c8baea475a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:34.199745 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-06196486-6b86-4a6e-a8b3-20c8baea475a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:34.210553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-06196486-6b86-4a6e-a8b3-20c8baea475a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:34.211021 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-06196486-6b86-4a6e-a8b3-20c8baea475a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:34.212976 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-06196486-6b86-4a6e-a8b3-20c8baea475a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:34.214099 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-06196486-6b86-4a6e-a8b3-20c8baea475a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:34.422269 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7814b726-0136-42c3-b76e-baf866961c60 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:34.424249 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7814b726-0136-42c3-b76e-baf866961c60 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:34.431284 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7814b726-0136-42c3-b76e-baf866961c60 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:34.432090 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7814b726-0136-42c3-b76e-baf866961c60 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:34.433321 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7814b726-0136-42c3-b76e-baf866961c60 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:34.433841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7814b726-0136-42c3-b76e-baf866961c60 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:34.441559 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-06196486-6b86-4a6e-a8b3-20c8baea475a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:34.456569 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-06196486-6b86-4a6e-a8b3-20c8baea475a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.266641 Aug 01 07:39:34.490159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 169/326] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:34 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:34.500860 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7be9ffbe-86e4-4823-ad10-624939b35b07 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:34.503154 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7be9ffbe-86e4-4823-ad10-624939b35b07 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:34.513045 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7be9ffbe-86e4-4823-ad10-624939b35b07 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:34.514123 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7be9ffbe-86e4-4823-ad10-624939b35b07 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:34.515339 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7be9ffbe-86e4-4823-ad10-624939b35b07 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:34.516078 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7be9ffbe-86e4-4823-ad10-624939b35b07 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:34.700906 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7be9ffbe-86e4-4823-ad10-624939b35b07 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:34.711569 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7be9ffbe-86e4-4823-ad10-624939b35b07 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.220052 Aug 01 07:39:34.714602 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 170/327] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:34 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:34.724638 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1fbee6f8-2af8-49ca-a1b1-8db52cc53922 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:34.725790 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1fbee6f8-2af8-49ca-a1b1-8db52cc53922 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:34.736408 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1fbee6f8-2af8-49ca-a1b1-8db52cc53922 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:34.737174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1fbee6f8-2af8-49ca-a1b1-8db52cc53922 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:34.738820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1fbee6f8-2af8-49ca-a1b1-8db52cc53922 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:34.739859 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1fbee6f8-2af8-49ca-a1b1-8db52cc53922 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:34.757026 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7814b726-0136-42c3-b76e-baf866961c60 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:34.767994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7814b726-0136-42c3-b76e-baf866961c60 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:34.772162 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7814b726-0136-42c3-b76e-baf866961c60 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:34.775345 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7814b726-0136-42c3-b76e-baf866961c60 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1744 microversion: 2.20 time: 0.357473 Aug 01 07:39:34.776105 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 158/328] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:34 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1744 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:34.910770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1fbee6f8-2af8-49ca-a1b1-8db52cc53922 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:34.921502 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1fbee6f8-2af8-49ca-a1b1-8db52cc53922 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.205460 Aug 01 07:39:34.922671 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 171/329] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:34 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:35.481884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a736f836-2c18-44ed-8797-22c8287f79f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:35.482653 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a736f836-2c18-44ed-8797-22c8287f79f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:35.500335 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a736f836-2c18-44ed-8797-22c8287f79f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:35.501252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a736f836-2c18-44ed-8797-22c8287f79f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:35.502262 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a736f836-2c18-44ed-8797-22c8287f79f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:35.503025 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a736f836-2c18-44ed-8797-22c8287f79f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:35.745127 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ecf3ffe3-e8e4-49e8-ac99-c6cdb94f14ea tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:35.745798 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ecf3ffe3-e8e4-49e8-ac99-c6cdb94f14ea tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:35.757997 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ecf3ffe3-e8e4-49e8-ac99-c6cdb94f14ea tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:35.760354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ecf3ffe3-e8e4-49e8-ac99-c6cdb94f14ea tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:35.763279 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ecf3ffe3-e8e4-49e8-ac99-c6cdb94f14ea tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:35.763832 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ecf3ffe3-e8e4-49e8-ac99-c6cdb94f14ea tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:35.770065 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a736f836-2c18-44ed-8797-22c8287f79f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:35.781859 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a736f836-2c18-44ed-8797-22c8287f79f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.303596 Aug 01 07:39:35.800940 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 159/330] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:35 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:35.809269 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-aa506cd8-b721-4d96-af24-5a05b52eb384 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:35.817338 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-aa506cd8-b721-4d96-af24-5a05b52eb384 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:35.829569 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aa506cd8-b721-4d96-af24-5a05b52eb384 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:35.833303 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aa506cd8-b721-4d96-af24-5a05b52eb384 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:35.836315 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aa506cd8-b721-4d96-af24-5a05b52eb384 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:35.836872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aa506cd8-b721-4d96-af24-5a05b52eb384 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:36.119548 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ecf3ffe3-e8e4-49e8-ac99-c6cdb94f14ea tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:36.133268 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ecf3ffe3-e8e4-49e8-ac99-c6cdb94f14ea tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.396574 Aug 01 07:39:36.135105 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 172/331] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:35 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:36.140362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-db2b194a-1fc4-4eb8-962b-6178dd77fe15 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:36.141061 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-db2b194a-1fc4-4eb8-962b-6178dd77fe15 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:36.148285 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-db2b194a-1fc4-4eb8-962b-6178dd77fe15 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:36.148746 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-db2b194a-1fc4-4eb8-962b-6178dd77fe15 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:36.153340 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-aa506cd8-b721-4d96-af24-5a05b52eb384 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:36.160363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-db2b194a-1fc4-4eb8-962b-6178dd77fe15 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:36.161296 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-db2b194a-1fc4-4eb8-962b-6178dd77fe15 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:36.181530 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-aa506cd8-b721-4d96-af24-5a05b52eb384 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:36.183808 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-aa506cd8-b721-4d96-af24-5a05b52eb384 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:36.185580 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-aa506cd8-b721-4d96-af24-5a05b52eb384 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1744 microversion: 2.20 time: 0.383428 Aug 01 07:39:36.193302 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 160/332] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:35 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1744 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:36.443209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-db2b194a-1fc4-4eb8-962b-6178dd77fe15 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:36.453320 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-db2b194a-1fc4-4eb8-962b-6178dd77fe15 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.316896 Aug 01 07:39:36.454647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 173/333] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:36 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:36.808895 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7c4e3290-24e3-4714-b3ae-a306e8dbc405 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:36.809707 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7c4e3290-24e3-4714-b3ae-a306e8dbc405 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:36.820404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c4e3290-24e3-4714-b3ae-a306e8dbc405 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:36.825514 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c4e3290-24e3-4714-b3ae-a306e8dbc405 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:36.827815 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c4e3290-24e3-4714-b3ae-a306e8dbc405 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:36.830549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c4e3290-24e3-4714-b3ae-a306e8dbc405 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:37.122843 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7c4e3290-24e3-4714-b3ae-a306e8dbc405 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:37.133695 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7c4e3290-24e3-4714-b3ae-a306e8dbc405 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.329196 Aug 01 07:39:37.134982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 161/334] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:36 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:37.155607 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-cfe0ddeb-7d0b-4ad7-89f5-cf4ba9543ff3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:37.156878 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-cfe0ddeb-7d0b-4ad7-89f5-cf4ba9543ff3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:37.171116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cfe0ddeb-7d0b-4ad7-89f5-cf4ba9543ff3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:37.171816 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cfe0ddeb-7d0b-4ad7-89f5-cf4ba9543ff3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:37.172634 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cfe0ddeb-7d0b-4ad7-89f5-cf4ba9543ff3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:37.175706 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cfe0ddeb-7d0b-4ad7-89f5-cf4ba9543ff3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:37.211753 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7d00fde1-dbc1-414c-925d-7f09a7aec1f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:37.212420 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7d00fde1-dbc1-414c-925d-7f09a7aec1f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:37.223499 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7d00fde1-dbc1-414c-925d-7f09a7aec1f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:37.224242 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7d00fde1-dbc1-414c-925d-7f09a7aec1f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:37.225263 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7d00fde1-dbc1-414c-925d-7f09a7aec1f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:37.231933 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7d00fde1-dbc1-414c-925d-7f09a7aec1f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:37.407946 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7d00fde1-dbc1-414c-925d-7f09a7aec1f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:37.418002 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7d00fde1-dbc1-414c-925d-7f09a7aec1f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:37.424170 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7d00fde1-dbc1-414c-925d-7f09a7aec1f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:37.425771 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7d00fde1-dbc1-414c-925d-7f09a7aec1f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1744 microversion: 2.20 time: 0.219001 Aug 01 07:39:37.426872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 162/335] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:37 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:37.480427 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-91a58827-8c6c-4362-a20a-077fe5859909 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:37.481433 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-91a58827-8c6c-4362-a20a-077fe5859909 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:37.487982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91a58827-8c6c-4362-a20a-077fe5859909 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:37.488713 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91a58827-8c6c-4362-a20a-077fe5859909 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:37.489670 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91a58827-8c6c-4362-a20a-077fe5859909 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:37.490260 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91a58827-8c6c-4362-a20a-077fe5859909 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:37.740873 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-cfe0ddeb-7d0b-4ad7-89f5-cf4ba9543ff3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:37.757698 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-cfe0ddeb-7d0b-4ad7-89f5-cf4ba9543ff3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.606058 Aug 01 07:39:37.762799 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 174/336] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:37 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:37.785425 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-91a58827-8c6c-4362-a20a-077fe5859909 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:37.834746 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-91a58827-8c6c-4362-a20a-077fe5859909 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.358008 Aug 01 07:39:37.852786 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 163/337] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:37 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:38.157562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-cf4030f9-84cb-4855-9c46-bddb1ca30ec9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:38.160051 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-cf4030f9-84cb-4855-9c46-bddb1ca30ec9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:38.181585 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cf4030f9-84cb-4855-9c46-bddb1ca30ec9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:38.182751 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cf4030f9-84cb-4855-9c46-bddb1ca30ec9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:38.187475 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cf4030f9-84cb-4855-9c46-bddb1ca30ec9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:38.188447 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cf4030f9-84cb-4855-9c46-bddb1ca30ec9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:38.455503 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c7c5c6f8-2c22-4d74-ae74-5d8a5a32abd0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:38.456609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c7c5c6f8-2c22-4d74-ae74-5d8a5a32abd0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:38.470850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7c5c6f8-2c22-4d74-ae74-5d8a5a32abd0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:38.471324 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7c5c6f8-2c22-4d74-ae74-5d8a5a32abd0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:38.472293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7c5c6f8-2c22-4d74-ae74-5d8a5a32abd0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:38.472873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7c5c6f8-2c22-4d74-ae74-5d8a5a32abd0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:38.520394 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-cf4030f9-84cb-4855-9c46-bddb1ca30ec9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:38.534719 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-cf4030f9-84cb-4855-9c46-bddb1ca30ec9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.379044 Aug 01 07:39:38.550611 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 175/338] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:38 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:38.711655 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c7c5c6f8-2c22-4d74-ae74-5d8a5a32abd0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:38.743410 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c7c5c6f8-2c22-4d74-ae74-5d8a5a32abd0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:38.750655 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c7c5c6f8-2c22-4d74-ae74-5d8a5a32abd0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:38.754260 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c7c5c6f8-2c22-4d74-ae74-5d8a5a32abd0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1744 microversion: 2.20 time: 0.303838 Aug 01 07:39:38.757087 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 164/339] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:38 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1744 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:38.783407 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-97158a6a-dc3f-4725-ac44-a3f9553d410b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:38.784261 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-97158a6a-dc3f-4725-ac44-a3f9553d410b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:38.793681 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-97158a6a-dc3f-4725-ac44-a3f9553d410b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:38.795097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-97158a6a-dc3f-4725-ac44-a3f9553d410b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:38.796709 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-97158a6a-dc3f-4725-ac44-a3f9553d410b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:38.797331 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-97158a6a-dc3f-4725-ac44-a3f9553d410b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:38.868297 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3b5360b5-0216-4f18-8eff-854a8c69be93 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:38.869802 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3b5360b5-0216-4f18-8eff-854a8c69be93 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:38.881356 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3b5360b5-0216-4f18-8eff-854a8c69be93 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:38.884578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3b5360b5-0216-4f18-8eff-854a8c69be93 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:38.885707 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3b5360b5-0216-4f18-8eff-854a8c69be93 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:38.886308 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3b5360b5-0216-4f18-8eff-854a8c69be93 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:39.136863 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3b5360b5-0216-4f18-8eff-854a8c69be93 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:39.146775 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:39.152090 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3b5360b5-0216-4f18-8eff-854a8c69be93 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.287712 Aug 01 07:39:39.165469 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 165/340] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:38 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:39.260104 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-97158a6a-dc3f-4725-ac44-a3f9553d410b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:39.274910 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-97158a6a-dc3f-4725-ac44-a3f9553d410b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.497545 Aug 01 07:39:39.278469 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 176/341] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:38 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:39.562606 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fc38d90a-a1c4-406c-b8bd-7c37cbe57544 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:39.564404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fc38d90a-a1c4-406c-b8bd-7c37cbe57544 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:39.580595 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:39.585831 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fc38d90a-a1c4-406c-b8bd-7c37cbe57544 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:39.587777 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fc38d90a-a1c4-406c-b8bd-7c37cbe57544 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:39.588987 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fc38d90a-a1c4-406c-b8bd-7c37cbe57544 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:39.591997 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fc38d90a-a1c4-406c-b8bd-7c37cbe57544 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:39.781221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c1f9359d-7fe0-40bf-9cee-60d01fe82674 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:39.781757 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c1f9359d-7fe0-40bf-9cee-60d01fe82674 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:39.800214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c1f9359d-7fe0-40bf-9cee-60d01fe82674 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:39.801014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c1f9359d-7fe0-40bf-9cee-60d01fe82674 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:39.801997 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c1f9359d-7fe0-40bf-9cee-60d01fe82674 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:39.802595 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c1f9359d-7fe0-40bf-9cee-60d01fe82674 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:39.903255 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fc38d90a-a1c4-406c-b8bd-7c37cbe57544 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:39.911445 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fc38d90a-a1c4-406c-b8bd-7c37cbe57544 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.356744 Aug 01 07:39:39.929334 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 166/342] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:39 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:40.180281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a50653af-c0bb-438a-ba92-5ee136615792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:40.181192 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a50653af-c0bb-438a-ba92-5ee136615792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:40.195214 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a50653af-c0bb-438a-ba92-5ee136615792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:40.196699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a50653af-c0bb-438a-ba92-5ee136615792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:40.200033 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a50653af-c0bb-438a-ba92-5ee136615792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:40.201420 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a50653af-c0bb-438a-ba92-5ee136615792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:40.336800 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c1f9359d-7fe0-40bf-9cee-60d01fe82674 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:40.355894 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c1f9359d-7fe0-40bf-9cee-60d01fe82674 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:40.364214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c1f9359d-7fe0-40bf-9cee-60d01fe82674 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:40.365616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c1f9359d-7fe0-40bf-9cee-60d01fe82674 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.588726 Aug 01 07:39:40.366168 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 177/343] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:39 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:40.390305 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5a3de546-a287-4d90-b2eb-eb991b32974f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:40.391014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5a3de546-a287-4d90-b2eb-eb991b32974f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:40.407411 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5a3de546-a287-4d90-b2eb-eb991b32974f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:40.407874 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5a3de546-a287-4d90-b2eb-eb991b32974f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:40.408666 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5a3de546-a287-4d90-b2eb-eb991b32974f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:40.409118 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5a3de546-a287-4d90-b2eb-eb991b32974f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:40.559407 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a50653af-c0bb-438a-ba92-5ee136615792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:40.571468 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a50653af-c0bb-438a-ba92-5ee136615792 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.395833 Aug 01 07:39:40.590142 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 167/344] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:40 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:40.721345 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-5fd10ebe-9df6-4aef-a326-d467984176c8 req-06db6d4e-b500-4a9a-a6f2-c4ae067a7f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff143cc-5a30-44be-a327-29eaacf61348", "name": "network-vif-plugged", "status": "completed", "tag": "7b59d41d-43d0-4098-917e-f7635e0051db"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:40.738532 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-5fd10ebe-9df6-4aef-a326-d467984176c8 req-06db6d4e-b500-4a9a-a6f2-c4ae067a7f92 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:40.739760 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-5fd10ebe-9df6-4aef-a326-d467984176c8 req-06db6d4e-b500-4a9a-a6f2-c4ae067a7f92 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:40.784055 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-5fd10ebe-9df6-4aef-a326-d467984176c8 req-06db6d4e-b500-4a9a-a6f2-c4ae067a7f92 service nova] Creating event network-vif-plugged:7b59d41d-43d0-4098-917e-f7635e0051db for instance 8ff143cc-5a30-44be-a327-29eaacf61348 on hv-cinder-73306 Aug 01 07:39:40.797295 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-5fd10ebe-9df6-4aef-a326-d467984176c8 req-06db6d4e-b500-4a9a-a6f2-c4ae067a7f92 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079201 Aug 01 07:39:40.803459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 168/345] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:39:40.914573 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5a3de546-a287-4d90-b2eb-eb991b32974f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:40.934985 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4731a202-8d16-48c8-9682-4c7667c7eb77 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:40.936519 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4731a202-8d16-48c8-9682-4c7667c7eb77 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:40.939171 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5a3de546-a287-4d90-b2eb-eb991b32974f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1725 microversion: 2.1 time: 0.563136 Aug 01 07:39:40.943573 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 178/346] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:40 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1725 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:40.952586 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4731a202-8d16-48c8-9682-4c7667c7eb77 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:40.959404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4731a202-8d16-48c8-9682-4c7667c7eb77 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:40.969104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4731a202-8d16-48c8-9682-4c7667c7eb77 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:40.969996 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4731a202-8d16-48c8-9682-4c7667c7eb77 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:41.152997 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4731a202-8d16-48c8-9682-4c7667c7eb77 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:41.167749 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4731a202-8d16-48c8-9682-4c7667c7eb77 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.237453 Aug 01 07:39:41.168688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 169/347] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:40 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:41.396067 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-332767b3-8fbc-4ec2-a00c-b1fcdd1932e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:41.396748 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-332767b3-8fbc-4ec2-a00c-b1fcdd1932e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:41.424595 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-332767b3-8fbc-4ec2-a00c-b1fcdd1932e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:41.425067 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-332767b3-8fbc-4ec2-a00c-b1fcdd1932e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:41.443645 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-332767b3-8fbc-4ec2-a00c-b1fcdd1932e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:41.443964 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-332767b3-8fbc-4ec2-a00c-b1fcdd1932e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:41.598978 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b69182be-82e7-4488-b4f9-ddd3ffb6d463 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:41.599874 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b69182be-82e7-4488-b4f9-ddd3ffb6d463 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:41.631722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b69182be-82e7-4488-b4f9-ddd3ffb6d463 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:41.632188 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b69182be-82e7-4488-b4f9-ddd3ffb6d463 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:41.633015 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b69182be-82e7-4488-b4f9-ddd3ffb6d463 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:41.633460 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b69182be-82e7-4488-b4f9-ddd3ffb6d463 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:41.760865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-332767b3-8fbc-4ec2-a00c-b1fcdd1932e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:41.770212 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-332767b3-8fbc-4ec2-a00c-b1fcdd1932e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:41.777773 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-332767b3-8fbc-4ec2-a00c-b1fcdd1932e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:41.781644 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-332767b3-8fbc-4ec2-a00c-b1fcdd1932e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.391410 Aug 01 07:39:41.787774 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 179/348] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:41 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:41.967250 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-71eec7ea-f8e7-437e-8150-e415da4a294b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:41.968309 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-71eec7ea-f8e7-437e-8150-e415da4a294b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:41.976668 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-71eec7ea-f8e7-437e-8150-e415da4a294b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:41.977120 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-71eec7ea-f8e7-437e-8150-e415da4a294b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:41.977914 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-71eec7ea-f8e7-437e-8150-e415da4a294b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:41.978362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-71eec7ea-f8e7-437e-8150-e415da4a294b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:42.327006 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b69182be-82e7-4488-b4f9-ddd3ffb6d463 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:42.339513 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b69182be-82e7-4488-b4f9-ddd3ffb6d463 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.745015 Aug 01 07:39:42.375507 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 170/349] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:41 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:42.389620 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e664bf78-e2f3-464e-b5e3-e1061d7bf8a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:42.395656 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e664bf78-e2f3-464e-b5e3-e1061d7bf8a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:42.409708 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e664bf78-e2f3-464e-b5e3-e1061d7bf8a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:42.410165 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e664bf78-e2f3-464e-b5e3-e1061d7bf8a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:42.412913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e664bf78-e2f3-464e-b5e3-e1061d7bf8a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:42.413408 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e664bf78-e2f3-464e-b5e3-e1061d7bf8a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:42.622382 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-71eec7ea-f8e7-437e-8150-e415da4a294b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:42.657499 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-71eec7ea-f8e7-437e-8150-e415da4a294b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1702 microversion: 2.1 time: 0.690389 Aug 01 07:39:42.682850 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 180/350] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:41 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1702 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:42.715160 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2eb08045-68ef-4248-9e80-c6a86f57216c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:42.754528 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2eb08045-68ef-4248-9e80-c6a86f57216c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:42.756656 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2eb08045-68ef-4248-9e80-c6a86f57216c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:42.785574 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e664bf78-e2f3-464e-b5e3-e1061d7bf8a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:42.800685 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e664bf78-e2f3-464e-b5e3-e1061d7bf8a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.417656 Aug 01 07:39:42.801263 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 171/351] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:42 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:42.822495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6d4a15b5-b231-4a33-a656-face4b697ff5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:42.823010 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6d4a15b5-b231-4a33-a656-face4b697ff5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:42.839253 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6d4a15b5-b231-4a33-a656-face4b697ff5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:42.842466 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6d4a15b5-b231-4a33-a656-face4b697ff5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:42.844753 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6d4a15b5-b231-4a33-a656-face4b697ff5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:42.849158 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6d4a15b5-b231-4a33-a656-face4b697ff5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:42.854066 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2eb08045-68ef-4248-9e80-c6a86f57216c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Going to try to start instance {{(pid=124279) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 07:39:42.931704 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:42.952890 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2eb08045-68ef-4248-9e80-c6a86f57216c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/action" status: 202 len: 0 microversion: 2.1 time: 0.268400 Aug 01 07:39:42.956434 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 181/352] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:39:42 2022] POST /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:39:42.980504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4608399b-c3ef-4206-92f9-184b052e56de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:42.995139 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4608399b-c3ef-4206-92f9-184b052e56de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:43.035517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4608399b-c3ef-4206-92f9-184b052e56de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:43.035986 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4608399b-c3ef-4206-92f9-184b052e56de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:43.048170 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4608399b-c3ef-4206-92f9-184b052e56de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:43.052688 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4608399b-c3ef-4206-92f9-184b052e56de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:43.324093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6d4a15b5-b231-4a33-a656-face4b697ff5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:43.333005 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6d4a15b5-b231-4a33-a656-face4b697ff5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:43.350082 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6d4a15b5-b231-4a33-a656-face4b697ff5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:43.351446 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6d4a15b5-b231-4a33-a656-face4b697ff5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.532780 Aug 01 07:39:43.355780 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 172/353] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:42 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:39:43.367375 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-19158b9f-f054-44d7-a910-c851c62c4b98 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:43.370017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-19158b9f-f054-44d7-a910-c851c62c4b98 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:43.391815 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-19158b9f-f054-44d7-a910-c851c62c4b98 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:43.397215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-19158b9f-f054-44d7-a910-c851c62c4b98 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:43.398493 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-19158b9f-f054-44d7-a910-c851c62c4b98 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:43.398950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-19158b9f-f054-44d7-a910-c851c62c4b98 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:43.652955 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4608399b-c3ef-4206-92f9-184b052e56de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:43.665513 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4608399b-c3ef-4206-92f9-184b052e56de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1711 microversion: 2.1 time: 0.703252 Aug 01 07:39:43.681554 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 182/354] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:42 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1711 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:43.827974 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ee8cd027-440f-48d4-984f-2a03965505f1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:43.829341 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ee8cd027-440f-48d4-984f-2a03965505f1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:43.850322 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ee8cd027-440f-48d4-984f-2a03965505f1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:43.853637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ee8cd027-440f-48d4-984f-2a03965505f1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:43.855650 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ee8cd027-440f-48d4-984f-2a03965505f1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:43.856304 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ee8cd027-440f-48d4-984f-2a03965505f1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:44.232284 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ee8cd027-440f-48d4-984f-2a03965505f1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:44.258704 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ee8cd027-440f-48d4-984f-2a03965505f1 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.436477 Aug 01 07:39:44.290081 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 183/355] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:43 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:44.389634 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-96203d67-97af-49e4-9372-1cf756806705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:44.391281 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-96203d67-97af-49e4-9372-1cf756806705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:44.419398 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-96203d67-97af-49e4-9372-1cf756806705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:44.420283 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-96203d67-97af-49e4-9372-1cf756806705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:44.421349 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-96203d67-97af-49e4-9372-1cf756806705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:44.429773 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-96203d67-97af-49e4-9372-1cf756806705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:44.803030 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-96203d67-97af-49e4-9372-1cf756806705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:44.816444 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-96203d67-97af-49e4-9372-1cf756806705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:44.836107 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-96203d67-97af-49e4-9372-1cf756806705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:44.837516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-96203d67-97af-49e4-9372-1cf756806705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.459940 Aug 01 07:39:44.838224 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 184/356] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:44 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:39:44.862125 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-8428a8e5-1c70-41f3-b786-51219befc023 req-91c8c896-892b-4d5a-b7a9-19b42f88eed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b28df3b-0e7f-425f-9e11-c2e34a32f31e", "name": "network-vif-plugged", "status": "completed", "tag": "8385f662-a544-477f-910d-b785d83e699e"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:44.869096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-19158b9f-f054-44d7-a910-c851c62c4b98 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:44.879407 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-8428a8e5-1c70-41f3-b786-51219befc023 req-91c8c896-892b-4d5a-b7a9-19b42f88eed0 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:44.881763 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-8428a8e5-1c70-41f3-b786-51219befc023 req-91c8c896-892b-4d5a-b7a9-19b42f88eed0 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:44.888432 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-19158b9f-f054-44d7-a910-c851c62c4b98 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 1.523809 Aug 01 07:39:44.900364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 173/357] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:43 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:44.912627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-acd08b54-5a6b-4200-b74b-d6ff1fb6be87 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:44.913575 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-acd08b54-5a6b-4200-b74b-d6ff1fb6be87 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:44.918726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-8428a8e5-1c70-41f3-b786-51219befc023 req-91c8c896-892b-4d5a-b7a9-19b42f88eed0 service nova] Creating event network-vif-plugged:8385f662-a544-477f-910d-b785d83e699e for instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e on hv-cinder-73306 Aug 01 07:39:44.932783 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-acd08b54-5a6b-4200-b74b-d6ff1fb6be87 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:44.933401 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-acd08b54-5a6b-4200-b74b-d6ff1fb6be87 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:44.934305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-acd08b54-5a6b-4200-b74b-d6ff1fb6be87 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:44.938238 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-8428a8e5-1c70-41f3-b786-51219befc023 req-91c8c896-892b-4d5a-b7a9-19b42f88eed0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082964 Aug 01 07:39:44.939056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-acd08b54-5a6b-4200-b74b-d6ff1fb6be87 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:44.942156 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 185/358] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:39:45.295824 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-acd08b54-5a6b-4200-b74b-d6ff1fb6be87 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:45.306286 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f615f4e0-ca96-4d82-baae-a732d7a99e3b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:45.307045 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f615f4e0-ca96-4d82-baae-a732d7a99e3b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:45.308981 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-acd08b54-5a6b-4200-b74b-d6ff1fb6be87 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1711 microversion: 2.1 time: 0.409095 Aug 01 07:39:45.314513 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 174/359] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:44 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1711 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:45.333170 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f615f4e0-ca96-4d82-baae-a732d7a99e3b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:45.334713 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f615f4e0-ca96-4d82-baae-a732d7a99e3b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:45.335522 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f615f4e0-ca96-4d82-baae-a732d7a99e3b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:45.337647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f615f4e0-ca96-4d82-baae-a732d7a99e3b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:45.865162 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1de9dd10-5d4f-429b-b513-e7c9e40af163 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:45.867864 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1de9dd10-5d4f-429b-b513-e7c9e40af163 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:45.884866 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1de9dd10-5d4f-429b-b513-e7c9e40af163 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:45.887717 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1de9dd10-5d4f-429b-b513-e7c9e40af163 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:45.892354 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1de9dd10-5d4f-429b-b513-e7c9e40af163 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:45.893089 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1de9dd10-5d4f-429b-b513-e7c9e40af163 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:46.071126 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f615f4e0-ca96-4d82-baae-a732d7a99e3b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:46.081268 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f615f4e0-ca96-4d82-baae-a732d7a99e3b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.780142 Aug 01 07:39:46.086296 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 186/360] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:45 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:46.099318 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-79198f88-a399-4d8b-a1f2-6b2a34a336eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:46.102686 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-79198f88-a399-4d8b-a1f2-6b2a34a336eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:46.120452 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79198f88-a399-4d8b-a1f2-6b2a34a336eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:46.121430 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79198f88-a399-4d8b-a1f2-6b2a34a336eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:46.122940 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79198f88-a399-4d8b-a1f2-6b2a34a336eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:46.123647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79198f88-a399-4d8b-a1f2-6b2a34a336eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:46.435215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1de9dd10-5d4f-429b-b513-e7c9e40af163 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:46.447615 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1de9dd10-5d4f-429b-b513-e7c9e40af163 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:46.451822 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1de9dd10-5d4f-429b-b513-e7c9e40af163 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:46.456569 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1de9dd10-5d4f-429b-b513-e7c9e40af163 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.598439 Aug 01 07:39:46.471740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 175/361] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:45 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:39:46.484091 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5960737a-43f4-4b07-8032-1d59e452666c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:46.485426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5960737a-43f4-4b07-8032-1d59e452666c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:46.504314 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5960737a-43f4-4b07-8032-1d59e452666c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:46.504995 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5960737a-43f4-4b07-8032-1d59e452666c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:46.505984 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5960737a-43f4-4b07-8032-1d59e452666c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:46.507578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5960737a-43f4-4b07-8032-1d59e452666c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:46.742654 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-79198f88-a399-4d8b-a1f2-6b2a34a336eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:46.756115 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-79198f88-a399-4d8b-a1f2-6b2a34a336eb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1502 microversion: 2.1 time: 0.668407 Aug 01 07:39:46.756715 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 187/362] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:46 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1502 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:46.783317 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-97303806-e9ee-4cf6-a3b7-2a8d252ae7ff tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d74804cf-3b93-47ea-9fe1-cbac609bf4bc"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:46.788913 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-97303806-e9ee-4cf6-a3b7-2a8d252ae7ff tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:46.795782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-97303806-e9ee-4cf6-a3b7-2a8d252ae7ff tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:46.797376 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-97303806-e9ee-4cf6-a3b7-2a8d252ae7ff tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:46.798713 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-97303806-e9ee-4cf6-a3b7-2a8d252ae7ff tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:46.799828 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-97303806-e9ee-4cf6-a3b7-2a8d252ae7ff tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:46.838325 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-97303806-e9ee-4cf6-a3b7-2a8d252ae7ff tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] HTTP exception thrown: Cannot 'attach_volume' instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e while it is in vm_state rescued Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-97303806-e9ee-4cf6-a3b7-2a8d252ae7ff tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Request method failure captured: Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: POST /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e/os-volume_attachments HTTP/1.1 Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 74 Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54Kyn7fgIOOlVQOe_iFzrxEhB5ZYfzP1N8kO7rOTuHfs3DHd50pdfNgKj05xoWbt8QDwaQiYV_jIV6PjClEExJj62j4pbOtwtSh24VBb1HaRP4_5Y1KFfIh0Ovn_SXpns93svbDb6A4SjUYl1K4CRkFTtLkXpwu2IlYTEfOiQxSjxW0 Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 015cc91d3e2f4d3791301c05e4c8be20 Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:39:46.841187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 015cc91d3e2f4d3791301c05e4c8be20 Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-ServerRescueNegativeTestJSON-86514510-project Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: db6ac4cf9dd84e338f944b4905dcdb50 Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-ServerRescueNegativeTestJSON-86514510-project Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {"volumeAttachment": {"volumeId": "d74804cf-3b93-47ea-9fe1-cbac609bf4bc"}} Aug 01 07:39:46.842591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Cannot 'attach_volume' instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e while it is in vm_state rescued Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'server_id': '61ee0c72-d5d4-4b77-a434-b3fbbaeae13e', 'body': {'volumeAttachment': {'volumeId': 'd74804cf-3b93-47ea-9fe1-cbac609bf4bc'}}} Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:39:46.843504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e while it is in vm_state rescued Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:39:46.845474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:39:46.846817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:39:46.846817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:39:46.846817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e while it is in vm_state rescued Aug 01 07:39:46.846817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:39:46.848005 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-97303806-e9ee-4cf6-a3b7-2a8d252ae7ff tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Returning 409 to user: Cannot 'attach_volume' instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e while it is in vm_state rescued {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:39:46.849694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-97303806-e9ee-4cf6-a3b7-2a8d252ae7ff tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.071599 Aug 01 07:39:46.850952 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 188/363] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:39:46 2022] POST /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e/os-volume_attachments => generated 152 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 01 07:39:46.862187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-81defc5c-8d20-4378-bb5b-01d7782b230b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:46.863725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-81defc5c-8d20-4378-bb5b-01d7782b230b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:46.867529 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5960737a-43f4-4b07-8032-1d59e452666c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:46.872437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-81defc5c-8d20-4378-bb5b-01d7782b230b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:46.873151 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-81defc5c-8d20-4378-bb5b-01d7782b230b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:46.874124 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-81defc5c-8d20-4378-bb5b-01d7782b230b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:46.874833 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-81defc5c-8d20-4378-bb5b-01d7782b230b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:46.880386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5960737a-43f4-4b07-8032-1d59e452666c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1711 microversion: 2.1 time: 0.406989 Aug 01 07:39:46.881246 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 176/364] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:46 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1711 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:47.009811 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-81defc5c-8d20-4378-bb5b-01d7782b230b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e/action" status: 202 len: 0 microversion: 2.1 time: 0.150467 Aug 01 07:39:47.014511 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 189/365] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:39:46 2022] POST /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:39:47.020132 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-011f60c8-2206-4723-8da2-6936c43288cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:47.021434 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-011f60c8-2206-4723-8da2-6936c43288cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:47.034539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-011f60c8-2206-4723-8da2-6936c43288cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:47.035464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-011f60c8-2206-4723-8da2-6936c43288cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:47.037608 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-011f60c8-2206-4723-8da2-6936c43288cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:47.040149 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-011f60c8-2206-4723-8da2-6936c43288cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:47.113244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-07d93e45-9966-4a69-a288-177e3a32ab7e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:47.115480 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-07d93e45-9966-4a69-a288-177e3a32ab7e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:47.127040 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=90 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:47.133854 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07d93e45-9966-4a69-a288-177e3a32ab7e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:47.134553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07d93e45-9966-4a69-a288-177e3a32ab7e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:47.136495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07d93e45-9966-4a69-a288-177e3a32ab7e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:47.137115 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07d93e45-9966-4a69-a288-177e3a32ab7e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:47.911688 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-07d93e45-9966-4a69-a288-177e3a32ab7e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:47.922014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-07d93e45-9966-4a69-a288-177e3a32ab7e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1260 microversion: 2.1 time: 0.814153 Aug 01 07:39:47.936877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 190/366] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:47 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1260 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:47.967048 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9e143212-f0be-4e44-90fa-d89ee1610f9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:47.968190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9e143212-f0be-4e44-90fa-d89ee1610f9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:47.984191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9e143212-f0be-4e44-90fa-d89ee1610f9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:47.985589 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9e143212-f0be-4e44-90fa-d89ee1610f9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:47.987406 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9e143212-f0be-4e44-90fa-d89ee1610f9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:47.988212 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9e143212-f0be-4e44-90fa-d89ee1610f9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:48.007896 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-011f60c8-2206-4723-8da2-6936c43288cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:48.017565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-011f60c8-2206-4723-8da2-6936c43288cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1510 microversion: 2.1 time: 1.001952 Aug 01 07:39:48.018183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 177/367] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:47 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1510 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:39:48.053965 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-94f20315-0cd1-45d6-b45f-9c8ba60f3239 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:48.054618 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-94f20315-0cd1-45d6-b45f-9c8ba60f3239 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:48.066962 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-94f20315-0cd1-45d6-b45f-9c8ba60f3239 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:48.089728 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-94f20315-0cd1-45d6-b45f-9c8ba60f3239 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:48.090950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-94f20315-0cd1-45d6-b45f-9c8ba60f3239 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:48.091661 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-94f20315-0cd1-45d6-b45f-9c8ba60f3239 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:48.465645 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9e143212-f0be-4e44-90fa-d89ee1610f9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:48.483424 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9e143212-f0be-4e44-90fa-d89ee1610f9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:48.490955 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9e143212-f0be-4e44-90fa-d89ee1610f9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:48.498279 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9e143212-f0be-4e44-90fa-d89ee1610f9a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.558350 Aug 01 07:39:48.499754 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 191/368] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:47 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:48.508374 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-94f20315-0cd1-45d6-b45f-9c8ba60f3239 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:48.525017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-94f20315-0cd1-45d6-b45f-9c8ba60f3239 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1715 microversion: 2.1 time: 0.505765 Aug 01 07:39:48.527320 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 178/369] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:48 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1715 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:48.945973 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3505a5cf-3019-4253-8379-5ae6a18c7675 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:48.946775 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3505a5cf-3019-4253-8379-5ae6a18c7675 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:48.972544 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3505a5cf-3019-4253-8379-5ae6a18c7675 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:48.982135 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3505a5cf-3019-4253-8379-5ae6a18c7675 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:49.011360 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3505a5cf-3019-4253-8379-5ae6a18c7675 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:49.011940 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3505a5cf-3019-4253-8379-5ae6a18c7675 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:49.039413 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d3601b26-dcea-4ea4-809a-30b77f9cd0e1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:49.040122 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d3601b26-dcea-4ea4-809a-30b77f9cd0e1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:49.056034 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3601b26-dcea-4ea4-809a-30b77f9cd0e1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:49.056681 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3601b26-dcea-4ea4-809a-30b77f9cd0e1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:49.057256 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3601b26-dcea-4ea4-809a-30b77f9cd0e1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:49.057694 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3601b26-dcea-4ea4-809a-30b77f9cd0e1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:49.475396 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3505a5cf-3019-4253-8379-5ae6a18c7675 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:49.512334 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3505a5cf-3019-4253-8379-5ae6a18c7675 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1443 microversion: 2.1 time: 0.566306 Aug 01 07:39:49.539195 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 192/370] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:48 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1443 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:49.560092 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-85c1f943-71e1-4c16-9612-df03679b1964 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:49.561883 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-85c1f943-71e1-4c16-9612-df03679b1964 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:49.583761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-85c1f943-71e1-4c16-9612-df03679b1964 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:49.585017 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-85c1f943-71e1-4c16-9612-df03679b1964 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:49.587373 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-85c1f943-71e1-4c16-9612-df03679b1964 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:49.590008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-85c1f943-71e1-4c16-9612-df03679b1964 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:49.637099 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d3601b26-dcea-4ea4-809a-30b77f9cd0e1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:49.649297 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d3601b26-dcea-4ea4-809a-30b77f9cd0e1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1510 microversion: 2.1 time: 0.614181 Aug 01 07:39:49.650853 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 179/371] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:49 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1510 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:49.655797 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-51064268-da55-436c-8256-99c2310750e5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:49.656701 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-51064268-da55-436c-8256-99c2310750e5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:49.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-51064268-da55-436c-8256-99c2310750e5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:49.671898 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-51064268-da55-436c-8256-99c2310750e5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:49.674219 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-51064268-da55-436c-8256-99c2310750e5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:49.678627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-51064268-da55-436c-8256-99c2310750e5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:49.867862 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-85c1f943-71e1-4c16-9612-df03679b1964 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:49.878518 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-85c1f943-71e1-4c16-9612-df03679b1964 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:49.895427 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-85c1f943-71e1-4c16-9612-df03679b1964 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:49.899251 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-85c1f943-71e1-4c16-9612-df03679b1964 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.357630 Aug 01 07:39:49.900673 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 193/372] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:49 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:49.975734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-51064268-da55-436c-8256-99c2310750e5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:49.987115 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-51064268-da55-436c-8256-99c2310750e5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1443 microversion: 2.1 time: 0.334896 Aug 01 07:39:49.990835 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 180/373] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:49 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1443 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:50.677233 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2d6f0345-6651-435f-b8c6-acf37beaf067 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:50.677854 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2d6f0345-6651-435f-b8c6-acf37beaf067 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:50.701141 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2d6f0345-6651-435f-b8c6-acf37beaf067 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:50.701526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2d6f0345-6651-435f-b8c6-acf37beaf067 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:50.702335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2d6f0345-6651-435f-b8c6-acf37beaf067 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:50.702779 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2d6f0345-6651-435f-b8c6-acf37beaf067 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:50.925115 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-29f7c187-7e5f-4ea6-a4ff-5b6618dcc504 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:50.925799 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-29f7c187-7e5f-4ea6-a4ff-5b6618dcc504 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:50.943049 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29f7c187-7e5f-4ea6-a4ff-5b6618dcc504 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:50.943932 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29f7c187-7e5f-4ea6-a4ff-5b6618dcc504 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:50.945138 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29f7c187-7e5f-4ea6-a4ff-5b6618dcc504 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:50.946033 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29f7c187-7e5f-4ea6-a4ff-5b6618dcc504 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:51.125102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2d6f0345-6651-435f-b8c6-acf37beaf067 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:51.139245 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2d6f0345-6651-435f-b8c6-acf37beaf067 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1510 microversion: 2.1 time: 0.467160 Aug 01 07:39:51.139852 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 194/374] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:50 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:51.318821 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-29f7c187-7e5f-4ea6-a4ff-5b6618dcc504 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:51.332577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-29f7c187-7e5f-4ea6-a4ff-5b6618dcc504 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:51.334350 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-29f7c187-7e5f-4ea6-a4ff-5b6618dcc504 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:51.336153 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-29f7c187-7e5f-4ea6-a4ff-5b6618dcc504 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.416652 Aug 01 07:39:51.337582 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 181/375] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:50 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:52.161522 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-68a86109-6114-4f3d-b4a8-20bb9cfbf11b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:52.163038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-68a86109-6114-4f3d-b4a8-20bb9cfbf11b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:52.176190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68a86109-6114-4f3d-b4a8-20bb9cfbf11b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:52.179091 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68a86109-6114-4f3d-b4a8-20bb9cfbf11b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:52.180143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68a86109-6114-4f3d-b4a8-20bb9cfbf11b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:52.181949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68a86109-6114-4f3d-b4a8-20bb9cfbf11b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:52.368242 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1d7cf7db-5a17-4782-90a5-8c2a9eeeb988 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:52.369572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1d7cf7db-5a17-4782-90a5-8c2a9eeeb988 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:52.397138 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d7cf7db-5a17-4782-90a5-8c2a9eeeb988 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:52.398797 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d7cf7db-5a17-4782-90a5-8c2a9eeeb988 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:52.400302 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d7cf7db-5a17-4782-90a5-8c2a9eeeb988 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:52.400943 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d7cf7db-5a17-4782-90a5-8c2a9eeeb988 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:52.626409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-68a86109-6114-4f3d-b4a8-20bb9cfbf11b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:52.638954 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-68a86109-6114-4f3d-b4a8-20bb9cfbf11b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1510 microversion: 2.1 time: 0.482228 Aug 01 07:39:52.640369 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 195/376] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:52 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1510 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:52.957336 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1d7cf7db-5a17-4782-90a5-8c2a9eeeb988 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:52.975045 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1d7cf7db-5a17-4782-90a5-8c2a9eeeb988 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:52.976719 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1d7cf7db-5a17-4782-90a5-8c2a9eeeb988 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:52.981841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1d7cf7db-5a17-4782-90a5-8c2a9eeeb988 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.620746 Aug 01 07:39:52.998848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 182/377] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:52 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:39:53.682653 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b95c4641-2562-464b-8aea-78704f543742 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:53.689403 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b95c4641-2562-464b-8aea-78704f543742 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:53.710908 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b95c4641-2562-464b-8aea-78704f543742 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:53.712877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b95c4641-2562-464b-8aea-78704f543742 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:53.715347 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b95c4641-2562-464b-8aea-78704f543742 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:53.717455 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b95c4641-2562-464b-8aea-78704f543742 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:54.007026 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5e81a0fe-db23-405e-999f-230f00c16c16 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:54.007665 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5e81a0fe-db23-405e-999f-230f00c16c16 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:54.025731 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5e81a0fe-db23-405e-999f-230f00c16c16 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:54.026634 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5e81a0fe-db23-405e-999f-230f00c16c16 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:54.027638 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5e81a0fe-db23-405e-999f-230f00c16c16 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:54.032674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5e81a0fe-db23-405e-999f-230f00c16c16 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:54.124713 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:39:54.468786 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5e81a0fe-db23-405e-999f-230f00c16c16 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:54.508155 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5e81a0fe-db23-405e-999f-230f00c16c16 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:54.512287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5e81a0fe-db23-405e-999f-230f00c16c16 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:54.523645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5e81a0fe-db23-405e-999f-230f00c16c16 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.520077 Aug 01 07:39:54.527765 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 183/378] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:54 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:54.539328 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-5428bafd-df6e-473b-8d70-a64474b52230 req-9044ce6b-ca8f-4f2a-b4e4-44890621d9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b28df3b-0e7f-425f-9e11-c2e34a32f31e", "tag": "8385f662-a544-477f-910d-b785d83e699e"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:54.558795 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b95c4641-2562-464b-8aea-78704f543742 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:54.559755 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-5428bafd-df6e-473b-8d70-a64474b52230 req-9044ce6b-ca8f-4f2a-b4e4-44890621d9b3 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:54.560405 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-5428bafd-df6e-473b-8d70-a64474b52230 req-9044ce6b-ca8f-4f2a-b4e4-44890621d9b3 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:54.569005 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b95c4641-2562-464b-8aea-78704f543742 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1510 microversion: 2.1 time: 0.898949 Aug 01 07:39:54.579164 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 196/379] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:53 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1510 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:54.613639 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-5428bafd-df6e-473b-8d70-a64474b52230 req-9044ce6b-ca8f-4f2a-b4e4-44890621d9b3 service nova] Creating event network-changed:8385f662-a544-477f-910d-b785d83e699e for instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e on hv-cinder-73306 Aug 01 07:39:54.632326 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-5428bafd-df6e-473b-8d70-a64474b52230 req-9044ce6b-ca8f-4f2a-b4e4-44890621d9b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101739 Aug 01 07:39:54.641194 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 184/380] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:39:55.354490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-555ebb25-92e7-43ba-9a14-719356e5a712 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Action: 'create', calling method: .version_select at 0x7fd018a289d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1723413518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPADyztx+ePugagfN/ekIPyJ7y3Xxp6EC8nUdeJmC5xClNJGtkmcaDzsL75Yz8N3c0mRxzbTAhBW8WMUmAKki1d+RZ3bvqdLz3VPHhUPPws94DbrV86q0NOt2lVbt1+Abg=="}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:55.373042 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-555ebb25-92e7-43ba-9a14-719356e5a712 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Getting quotas for project 810069989cfb42799139be8ec2423288. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:39:55.378062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-555ebb25-92e7-43ba-9a14-719356e5a712 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Getting quotas for user 890be2e19b43473caa79b2dc889f8436 and project 810069989cfb42799139be8ec2423288. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:39:55.415583 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-555ebb25-92e7-43ba-9a14-719356e5a712 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.681585 Aug 01 07:39:55.416349 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 197/381] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 1 07:39:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:39:55.549617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ce211d57-118f-41cf-ae82-cd4071d1d7f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:55.550681 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ce211d57-118f-41cf-ae82-cd4071d1d7f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:55.564930 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ce211d57-118f-41cf-ae82-cd4071d1d7f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:55.567382 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ce211d57-118f-41cf-ae82-cd4071d1d7f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:55.568801 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ce211d57-118f-41cf-ae82-cd4071d1d7f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:55.571173 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ce211d57-118f-41cf-ae82-cd4071d1d7f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:55.600526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9cb23dbd-00c0-4f17-bf08-a0e5c6c595d6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:55.601901 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9cb23dbd-00c0-4f17-bf08-a0e5c6c595d6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:55.632723 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9cb23dbd-00c0-4f17-bf08-a0e5c6c595d6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:55.636150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9cb23dbd-00c0-4f17-bf08-a0e5c6c595d6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:55.640001 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9cb23dbd-00c0-4f17-bf08-a0e5c6c595d6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:55.645658 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9cb23dbd-00c0-4f17-bf08-a0e5c6c595d6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:56.238392 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ce211d57-118f-41cf-ae82-cd4071d1d7f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:56.253452 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ce211d57-118f-41cf-ae82-cd4071d1d7f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:56.255644 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ce211d57-118f-41cf-ae82-cd4071d1d7f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:56.257979 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ce211d57-118f-41cf-ae82-cd4071d1d7f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.713038 Aug 01 07:39:56.259937 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 185/382] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:55 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:56.356186 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9cb23dbd-00c0-4f17-bf08-a0e5c6c595d6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:56.380585 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9cb23dbd-00c0-4f17-bf08-a0e5c6c595d6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1516 microversion: 2.1 time: 0.777386 Aug 01 07:39:56.384634 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 198/383] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:39:55 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1516 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:39:57.287769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fe6525c6-4349-4f51-9435-02043f9afee7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:57.288435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fe6525c6-4349-4f51-9435-02043f9afee7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:57.327006 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe6525c6-4349-4f51-9435-02043f9afee7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:57.327607 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe6525c6-4349-4f51-9435-02043f9afee7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:57.331869 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe6525c6-4349-4f51-9435-02043f9afee7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:57.332446 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe6525c6-4349-4f51-9435-02043f9afee7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:57.642230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fe6525c6-4349-4f51-9435-02043f9afee7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:57.662328 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fe6525c6-4349-4f51-9435-02043f9afee7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:57.664919 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fe6525c6-4349-4f51-9435-02043f9afee7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:57.667663 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fe6525c6-4349-4f51-9435-02043f9afee7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.383759 Aug 01 07:39:57.669575 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 186/384] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:57 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:39:58.192904 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d0ee3829-c517-4481-affd-1948199f66da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'create', calling method: .version_select at 0x7fd018bf5ca0>, body: {"keypair": {"name": "tempest-keypair-273085578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGJ1yrCftyFdeAd0S4OIeX95h9dLWhfe0u8FzgKrYvVPC+XRb2G/diw1QvchJ+jZTw8A7I4Po/fUkW+wZKprrAcH99JPig5gKh+FWzp3/T0QTI9bj7b4/dwuKJ1VZdawg=="}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:39:58.227345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-d0ee3829-c517-4481-affd-1948199f66da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Getting quotas for project 015cc91d3e2f4d3791301c05e4c8be20. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:39:58.232977 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-d0ee3829-c517-4481-affd-1948199f66da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Getting quotas for user db6ac4cf9dd84e338f944b4905dcdb50 and project 015cc91d3e2f4d3791301c05e4c8be20. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:39:58.262251 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d0ee3829-c517-4481-affd-1948199f66da tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075434 Aug 01 07:39:58.263013 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 199/385] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 1 07:39:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:39:58.692710 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fcc969b4-9655-4725-988d-0d6bd4990a70 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:39:58.694024 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fcc969b4-9655-4725-988d-0d6bd4990a70 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:39:58.702626 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fcc969b4-9655-4725-988d-0d6bd4990a70 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:58.703948 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fcc969b4-9655-4725-988d-0d6bd4990a70 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:58.705070 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fcc969b4-9655-4725-988d-0d6bd4990a70 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:39:58.705771 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fcc969b4-9655-4725-988d-0d6bd4990a70 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:39:58.967669 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fcc969b4-9655-4725-988d-0d6bd4990a70 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:58.983764 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fcc969b4-9655-4725-988d-0d6bd4990a70 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:58.986198 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fcc969b4-9655-4725-988d-0d6bd4990a70 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:39:58.987560 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fcc969b4-9655-4725-988d-0d6bd4990a70 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.300188 Aug 01 07:39:58.988335 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 187/386] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:39:58 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:00.019398 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-fb207fb3-c7f0-461b-9909-e5237897caef tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:00.020771 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-fb207fb3-c7f0-461b-9909-e5237897caef tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:00.033184 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb207fb3-c7f0-461b-9909-e5237897caef tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:00.039613 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb207fb3-c7f0-461b-9909-e5237897caef tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:00.041378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb207fb3-c7f0-461b-9909-e5237897caef tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:00.043995 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb207fb3-c7f0-461b-9909-e5237897caef tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:00.087097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:00.388950 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fb207fb3-c7f0-461b-9909-e5237897caef tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:00.400112 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fb207fb3-c7f0-461b-9909-e5237897caef tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:00.402757 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fb207fb3-c7f0-461b-9909-e5237897caef tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:00.404187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-fb207fb3-c7f0-461b-9909-e5237897caef tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.390600 Aug 01 07:40:00.405274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 200/387] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:00 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:00.865680 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-530823596", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9823c1ef-0097-4726-b18e-20812226ba01"}], "security_groups": [{"name": "tempest-securitygroup--329239360"}], "key_name": "tempest-keypair-273085578", "user_data": "}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:01.428980 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1e93b43f-4693-4a4a-9357-c71fd87062c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:01.430225 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1e93b43f-4693-4a4a-9357-c71fd87062c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:01.439216 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1e93b43f-4693-4a4a-9357-c71fd87062c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:01.439673 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1e93b43f-4693-4a4a-9357-c71fd87062c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:01.440461 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1e93b43f-4693-4a4a-9357-c71fd87062c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:01.440900 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1e93b43f-4693-4a4a-9357-c71fd87062c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:01.605114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1e93b43f-4693-4a4a-9357-c71fd87062c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:01.618207 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1e93b43f-4693-4a4a-9357-c71fd87062c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:01.620131 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1e93b43f-4693-4a4a-9357-c71fd87062c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:01.627674 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1e93b43f-4693-4a4a-9357-c71fd87062c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.199404 Aug 01 07:40:01.628622 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 201/388] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:01 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:02.652303 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d90e5d27-0235-4995-bce1-983758cb8eb1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:02.652972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d90e5d27-0235-4995-bce1-983758cb8eb1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:02.660504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d90e5d27-0235-4995-bce1-983758cb8eb1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:02.660971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d90e5d27-0235-4995-bce1-983758cb8eb1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:02.661761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d90e5d27-0235-4995-bce1-983758cb8eb1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:02.662205 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d90e5d27-0235-4995-bce1-983758cb8eb1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:02.823204 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d90e5d27-0235-4995-bce1-983758cb8eb1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:02.831946 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d90e5d27-0235-4995-bce1-983758cb8eb1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:02.833445 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d90e5d27-0235-4995-bce1-983758cb8eb1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:02.834606 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d90e5d27-0235-4995-bce1-983758cb8eb1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1739 microversion: 2.20 time: 0.186291 Aug 01 07:40:02.835165 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 202/389] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:02 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:02.991187 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] validate_networks() for [('9823c1ef-0097-4726-b18e-20812226ba01', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:40:03.735855 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:40:03.736285 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:40:03.737141 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:40:03.738129 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:40:03.738646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:40:03.752403 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:03.752881 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:03.753927 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:03.754563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:03.772203 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Getting quotas for project 015cc91d3e2f4d3791301c05e4c8be20. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:40:03.776942 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Getting quotas for user db6ac4cf9dd84e338f944b4905dcdb50 and project 015cc91d3e2f4d3791301c05e4c8be20. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:40:03.789463 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:40:03.792079 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:40:03.862858 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-129c82d7-2b4f-45ae-ab7d-181dc4bf6c6d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:03.862858 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-129c82d7-2b4f-45ae-ab7d-181dc4bf6c6d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:03.866180 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-129c82d7-2b4f-45ae-ab7d-181dc4bf6c6d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:03.866874 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-129c82d7-2b4f-45ae-ab7d-181dc4bf6c6d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:03.868678 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4016667f-d640-41ab-bf72-2b2b892fa658 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.007218 Aug 01 07:40:03.869622 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 188/390] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:40:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 3010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:40:03.871274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-129c82d7-2b4f-45ae-ab7d-181dc4bf6c6d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:03.871726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-129c82d7-2b4f-45ae-ab7d-181dc4bf6c6d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:03.881771 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6b7fbbf8-bc59-4ea4-a1be-51b18ffb1325 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:03.882382 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6b7fbbf8-bc59-4ea4-a1be-51b18ffb1325 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:03.948770 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6b7fbbf8-bc59-4ea4-a1be-51b18ffb1325 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:03.958404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6b7fbbf8-bc59-4ea4-a1be-51b18ffb1325 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1244 microversion: 2.1 time: 0.080653 Aug 01 07:40:03.965679 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 189/391] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:03 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:04.080418 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-129c82d7-2b4f-45ae-ab7d-181dc4bf6c6d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:04.088761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-129c82d7-2b4f-45ae-ab7d-181dc4bf6c6d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:04.090369 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-129c82d7-2b4f-45ae-ab7d-181dc4bf6c6d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:04.091952 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-129c82d7-2b4f-45ae-ab7d-181dc4bf6c6d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1721 microversion: 2.20 time: 0.238141 Aug 01 07:40:04.092756 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 203/392] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:03 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:04.979512 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-74cfb3ff-12ed-4792-ac08-b43e52e9436d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:04.980114 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-74cfb3ff-12ed-4792-ac08-b43e52e9436d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:04.986847 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-74cfb3ff-12ed-4792-ac08-b43e52e9436d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:04.987323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-74cfb3ff-12ed-4792-ac08-b43e52e9436d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:04.988080 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-74cfb3ff-12ed-4792-ac08-b43e52e9436d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:04.988512 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-74cfb3ff-12ed-4792-ac08-b43e52e9436d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:05.050769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-74cfb3ff-12ed-4792-ac08-b43e52e9436d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:05.062284 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-74cfb3ff-12ed-4792-ac08-b43e52e9436d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1248 microversion: 2.1 time: 0.086622 Aug 01 07:40:05.062850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 190/393] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:04 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:05.115573 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3cb10665-cad0-4f00-8a7a-8b7b1d21a8d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:05.116177 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3cb10665-cad0-4f00-8a7a-8b7b1d21a8d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:05.122697 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3cb10665-cad0-4f00-8a7a-8b7b1d21a8d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:05.123125 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3cb10665-cad0-4f00-8a7a-8b7b1d21a8d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:05.123891 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3cb10665-cad0-4f00-8a7a-8b7b1d21a8d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:05.124328 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3cb10665-cad0-4f00-8a7a-8b7b1d21a8d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:05.265010 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3cb10665-cad0-4f00-8a7a-8b7b1d21a8d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:05.273961 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3cb10665-cad0-4f00-8a7a-8b7b1d21a8d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:05.275496 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3cb10665-cad0-4f00-8a7a-8b7b1d21a8d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:05.276644 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3cb10665-cad0-4f00-8a7a-8b7b1d21a8d7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1721 microversion: 2.20 time: 0.165238 Aug 01 07:40:05.277197 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 204/394] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:05 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:05.987651 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-b0875143-f3b2-4676-bd06-bb3e39b27ec0 req-cdbcc4ab-c223-4c15-95fd-7697f5ea52ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff143cc-5a30-44be-a327-29eaacf61348", "name": "network-vif-unplugged", "status": "completed", "tag": "7b59d41d-43d0-4098-917e-f7635e0051db"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:05.997154 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-b0875143-f3b2-4676-bd06-bb3e39b27ec0 req-cdbcc4ab-c223-4c15-95fd-7697f5ea52ea service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:05.997686 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-b0875143-f3b2-4676-bd06-bb3e39b27ec0 req-cdbcc4ab-c223-4c15-95fd-7697f5ea52ea service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:06.010207 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-b0875143-f3b2-4676-bd06-bb3e39b27ec0 req-cdbcc4ab-c223-4c15-95fd-7697f5ea52ea service nova] Creating event network-vif-unplugged:7b59d41d-43d0-4098-917e-f7635e0051db for instance 8ff143cc-5a30-44be-a327-29eaacf61348 on hv-cinder-73306 Aug 01 07:40:06.015238 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-b0875143-f3b2-4676-bd06-bb3e39b27ec0 req-cdbcc4ab-c223-4c15-95fd-7697f5ea52ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032043 Aug 01 07:40:06.015826 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 191/395] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:40:06.084192 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1140d8db-aa59-4ce8-9334-321d6c7500c0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:06.084826 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1140d8db-aa59-4ce8-9334-321d6c7500c0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:06.091015 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1140d8db-aa59-4ce8-9334-321d6c7500c0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:06.091500 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1140d8db-aa59-4ce8-9334-321d6c7500c0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:06.092281 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1140d8db-aa59-4ce8-9334-321d6c7500c0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:06.092725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1140d8db-aa59-4ce8-9334-321d6c7500c0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:06.154629 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1140d8db-aa59-4ce8-9334-321d6c7500c0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:06.165971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1140d8db-aa59-4ce8-9334-321d6c7500c0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1248 microversion: 2.1 time: 0.085439 Aug 01 07:40:06.166554 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 205/396] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:06 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:06.303196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8dda39e1-cab0-40d7-9d31-734591829f5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:06.303817 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8dda39e1-cab0-40d7-9d31-734591829f5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:06.312313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8dda39e1-cab0-40d7-9d31-734591829f5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:06.312841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8dda39e1-cab0-40d7-9d31-734591829f5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:06.314321 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8dda39e1-cab0-40d7-9d31-734591829f5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:06.315089 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8dda39e1-cab0-40d7-9d31-734591829f5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:06.463734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8dda39e1-cab0-40d7-9d31-734591829f5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:06.472630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8dda39e1-cab0-40d7-9d31-734591829f5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:06.474160 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8dda39e1-cab0-40d7-9d31-734591829f5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:06.475347 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8dda39e1-cab0-40d7-9d31-734591829f5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1724 microversion: 2.20 time: 0.178854 Aug 01 07:40:06.475903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 192/397] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:06 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:06.497528 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-af6c94dd-e45a-4d3f-811c-898afc121eb7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a0cf0e4-15ba-4f1c-a510-676bd36fb19a"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:06.499882 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-af6c94dd-e45a-4d3f-811c-898afc121eb7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:06.506716 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af6c94dd-e45a-4d3f-811c-898afc121eb7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:06.507203 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af6c94dd-e45a-4d3f-811c-898afc121eb7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:06.510221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af6c94dd-e45a-4d3f-811c-898afc121eb7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:06.510221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af6c94dd-e45a-4d3f-811c-898afc121eb7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:06.826582 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-af6c94dd-e45a-4d3f-811c-898afc121eb7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "POST /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.332844 Aug 01 07:40:06.827227 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 206/398] 10.222.0.40 () {62 vars in 1364 bytes} [Mon Aug 1 07:40:06 2022] POST /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:40:06.984245 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-50fd0e7e-6497-4685-8631-d723bbffb4c6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:06.984763 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-50fd0e7e-6497-4685-8631-d723bbffb4c6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:07.000576 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-50fd0e7e-6497-4685-8631-d723bbffb4c6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:07.001916 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-50fd0e7e-6497-4685-8631-d723bbffb4c6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:07.007521 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-50fd0e7e-6497-4685-8631-d723bbffb4c6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:07.008062 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-50fd0e7e-6497-4685-8631-d723bbffb4c6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:07.084881 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-50fd0e7e-6497-4685-8631-d723bbffb4c6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124280) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 07:40:07.187620 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8ec4d7cf-f0cf-4d1c-b773-75764861fa80 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:07.188229 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8ec4d7cf-f0cf-4d1c-b773-75764861fa80 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:07.195781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-50fd0e7e-6497-4685-8631-d723bbffb4c6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "POST /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/action" status: 202 len: 0 microversion: 2.20 time: 0.215797 Aug 01 07:40:07.197100 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 193/399] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Aug 1 07:40:06 2022] POST /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:40:07.201396 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8ec4d7cf-f0cf-4d1c-b773-75764861fa80 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:07.201918 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8ec4d7cf-f0cf-4d1c-b773-75764861fa80 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:07.202699 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8ec4d7cf-f0cf-4d1c-b773-75764861fa80 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:07.203182 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8ec4d7cf-f0cf-4d1c-b773-75764861fa80 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:07.206254 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7e39be45-9f6c-48ee-a453-3dac5f62d0c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:07.207379 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7e39be45-9f6c-48ee-a453-3dac5f62d0c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:07.219314 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e39be45-9f6c-48ee-a453-3dac5f62d0c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:07.219884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e39be45-9f6c-48ee-a453-3dac5f62d0c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:07.223476 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e39be45-9f6c-48ee-a453-3dac5f62d0c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:07.223957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e39be45-9f6c-48ee-a453-3dac5f62d0c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:07.319288 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8ec4d7cf-f0cf-4d1c-b773-75764861fa80 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:07.334392 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8ec4d7cf-f0cf-4d1c-b773-75764861fa80 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1302 microversion: 2.1 time: 0.151130 Aug 01 07:40:07.335947 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 207/400] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:07 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1302 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:07.484428 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7e39be45-9f6c-48ee-a453-3dac5f62d0c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:07.496988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7e39be45-9f6c-48ee-a453-3dac5f62d0c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:07.498889 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7e39be45-9f6c-48ee-a453-3dac5f62d0c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:07.500088 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7e39be45-9f6c-48ee-a453-3dac5f62d0c1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1750 microversion: 2.20 time: 0.299154 Aug 01 07:40:07.500803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 194/401] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:07 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1750 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:08.357319 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ef75ba7c-83a6-47de-80f4-eb76123133b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:08.357915 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ef75ba7c-83a6-47de-80f4-eb76123133b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:08.360959 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=8 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:08.366671 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ef75ba7c-83a6-47de-80f4-eb76123133b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:08.367357 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ef75ba7c-83a6-47de-80f4-eb76123133b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:08.368324 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ef75ba7c-83a6-47de-80f4-eb76123133b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:08.368814 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ef75ba7c-83a6-47de-80f4-eb76123133b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:08.524649 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-80a92eb4-4ad6-461b-b930-d2f1715c1a77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:08.526228 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-80a92eb4-4ad6-461b-b930-d2f1715c1a77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:08.534518 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-80a92eb4-4ad6-461b-b930-d2f1715c1a77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:08.534970 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-80a92eb4-4ad6-461b-b930-d2f1715c1a77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:08.536276 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-80a92eb4-4ad6-461b-b930-d2f1715c1a77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:08.536916 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-80a92eb4-4ad6-461b-b930-d2f1715c1a77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:08.600317 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ef75ba7c-83a6-47de-80f4-eb76123133b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:08.619417 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ef75ba7c-83a6-47de-80f4-eb76123133b7 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.266060 Aug 01 07:40:08.625853 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 208/402] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:08 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:08.756993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-474df187-188a-4503-aa36-0b8f63ed71dd req-7b692f82-cf53-4df6-ad63-a216175f3606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d", "tag": "62003bcf-02f7-4b14-97e3-6fad5084dd62"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:08.759221 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-80a92eb4-4ad6-461b-b930-d2f1715c1a77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:08.778966 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-474df187-188a-4503-aa36-0b8f63ed71dd req-7b692f82-cf53-4df6-ad63-a216175f3606 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:08.779217 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-80a92eb4-4ad6-461b-b930-d2f1715c1a77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:08.780259 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-474df187-188a-4503-aa36-0b8f63ed71dd req-7b692f82-cf53-4df6-ad63-a216175f3606 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:08.781149 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-80a92eb4-4ad6-461b-b930-d2f1715c1a77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:08.783506 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-80a92eb4-4ad6-461b-b930-d2f1715c1a77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1750 microversion: 2.20 time: 0.262553 Aug 01 07:40:08.784372 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 195/403] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:08 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1750 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:08.815284 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-474df187-188a-4503-aa36-0b8f63ed71dd req-7b692f82-cf53-4df6-ad63-a216175f3606 service nova] Creating event network-changed:62003bcf-02f7-4b14-97e3-6fad5084dd62 for instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d on hv-cinder-73306 Aug 01 07:40:08.821304 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-474df187-188a-4503-aa36-0b8f63ed71dd req-7b692f82-cf53-4df6-ad63-a216175f3606 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068767 Aug 01 07:40:08.821986 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 209/404] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:40:09.647664 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b485dad8-bed5-4cfb-b327-bac545de68cb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:09.648779 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b485dad8-bed5-4cfb-b327-bac545de68cb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:09.664399 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b485dad8-bed5-4cfb-b327-bac545de68cb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:09.665936 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b485dad8-bed5-4cfb-b327-bac545de68cb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:09.666918 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b485dad8-bed5-4cfb-b327-bac545de68cb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:09.667426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b485dad8-bed5-4cfb-b327-bac545de68cb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:09.820154 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-fcb0069a-330d-46ea-83ce-30c91855ca68 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:09.820154 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-fcb0069a-330d-46ea-83ce-30c91855ca68 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:09.824078 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fcb0069a-330d-46ea-83ce-30c91855ca68 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:09.824535 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fcb0069a-330d-46ea-83ce-30c91855ca68 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:09.825312 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fcb0069a-330d-46ea-83ce-30c91855ca68 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:09.825751 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fcb0069a-330d-46ea-83ce-30c91855ca68 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:09.927856 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b485dad8-bed5-4cfb-b327-bac545de68cb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:09.935899 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b485dad8-bed5-4cfb-b327-bac545de68cb tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.292696 Aug 01 07:40:09.936695 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 196/405] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:09 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:09.988728 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fcb0069a-330d-46ea-83ce-30c91855ca68 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:09.998090 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fcb0069a-330d-46ea-83ce-30c91855ca68 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:09.999724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fcb0069a-330d-46ea-83ce-30c91855ca68 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:10.001596 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-fcb0069a-330d-46ea-83ce-30c91855ca68 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1750 microversion: 2.20 time: 0.195812 Aug 01 07:40:10.002909 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 210/406] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:09 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1750 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:10.924890 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1348586581", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "networks": [{"uuid": "959bdb5b-127a-43d6-95d7-60fefef1792f"}]}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:10.934292 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:10.960355 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0ac3ce10-dcc8-4cfa-b8c4-e134736ba546 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:10.960966 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0ac3ce10-dcc8-4cfa-b8c4-e134736ba546 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:10.969479 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0ac3ce10-dcc8-4cfa-b8c4-e134736ba546 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:10.970590 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0ac3ce10-dcc8-4cfa-b8c4-e134736ba546 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:10.971518 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0ac3ce10-dcc8-4cfa-b8c4-e134736ba546 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:10.971953 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0ac3ce10-dcc8-4cfa-b8c4-e134736ba546 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:10.996376 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] validate_networks() for [('959bdb5b-127a-43d6-95d7-60fefef1792f', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:40:11.122037 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0ac3ce10-dcc8-4cfa-b8c4-e134736ba546 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:11.133883 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0ac3ce10-dcc8-4cfa-b8c4-e134736ba546 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.180100 Aug 01 07:40:11.134649 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 211/407] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:10 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:11.140914 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0e070216-508d-47cb-9911-9ecbff0d4dfc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:11.141905 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0e070216-508d-47cb-9911-9ecbff0d4dfc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:11.152728 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e070216-508d-47cb-9911-9ecbff0d4dfc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:11.153348 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e070216-508d-47cb-9911-9ecbff0d4dfc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:11.154677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e070216-508d-47cb-9911-9ecbff0d4dfc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:11.155209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e070216-508d-47cb-9911-9ecbff0d4dfc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:11.314477 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0e070216-508d-47cb-9911-9ecbff0d4dfc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:11.322820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0e070216-508d-47cb-9911-9ecbff0d4dfc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:11.324375 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0e070216-508d-47cb-9911-9ecbff0d4dfc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:11.325521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0e070216-508d-47cb-9911-9ecbff0d4dfc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1750 microversion: 2.20 time: 0.189755 Aug 01 07:40:11.326235 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 212/408] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:11 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1750 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:11.402366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:40:11.402788 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:40:11.403306 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:40:11.403713 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:40:11.404120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:40:11.413424 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:11.413868 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:11.414697 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:11.415183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:11.432177 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Getting quotas for project 4a76209de52146bf8440fddcdd00b284. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:40:11.436058 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Getting quotas for user 42a2bc662fa4405791532ebf2bce909c and project 4a76209de52146bf8440fddcdd00b284. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:40:11.446816 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:40:11.449149 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:40:11.493558 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2660319a-4694-43ce-a855-21dd26ca086f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574412 Aug 01 07:40:11.494206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 197/409] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:40:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:40:11.505380 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6799d06e-76e1-4529-9670-294d13bbe490 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:11.505899 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6799d06e-76e1-4529-9670-294d13bbe490 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:11.562477 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6799d06e-76e1-4529-9670-294d13bbe490 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:11.569671 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6799d06e-76e1-4529-9670-294d13bbe490 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1219 microversion: 2.1 time: 0.068614 Aug 01 07:40:11.570269 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 213/410] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:11 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:12.155778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-eed5b6e9-8b62-4d2d-ad0a-febc4289a91b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:12.163166 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-eed5b6e9-8b62-4d2d-ad0a-febc4289a91b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:12.171031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eed5b6e9-8b62-4d2d-ad0a-febc4289a91b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:12.171956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eed5b6e9-8b62-4d2d-ad0a-febc4289a91b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:12.173781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eed5b6e9-8b62-4d2d-ad0a-febc4289a91b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:12.174384 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eed5b6e9-8b62-4d2d-ad0a-febc4289a91b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:12.326991 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-eed5b6e9-8b62-4d2d-ad0a-febc4289a91b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:12.334878 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-eed5b6e9-8b62-4d2d-ad0a-febc4289a91b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.183499 Aug 01 07:40:12.335489 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 198/411] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:12 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:12.349811 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-839c5dca-d5d1-4709-92b0-5c6087db284c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:12.350510 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-839c5dca-d5d1-4709-92b0-5c6087db284c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:12.357254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-839c5dca-d5d1-4709-92b0-5c6087db284c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:12.357916 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-839c5dca-d5d1-4709-92b0-5c6087db284c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:12.358695 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-839c5dca-d5d1-4709-92b0-5c6087db284c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:12.359164 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-839c5dca-d5d1-4709-92b0-5c6087db284c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:12.498205 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-839c5dca-d5d1-4709-92b0-5c6087db284c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:12.507045 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-839c5dca-d5d1-4709-92b0-5c6087db284c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:12.508528 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-839c5dca-d5d1-4709-92b0-5c6087db284c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:12.509688 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-839c5dca-d5d1-4709-92b0-5c6087db284c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1752 microversion: 2.20 time: 0.163933 Aug 01 07:40:12.510282 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 214/412] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:12 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:12.590450 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-48e453c9-fa5a-45a9-97d4-418248aed402 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:12.591143 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-48e453c9-fa5a-45a9-97d4-418248aed402 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:12.598048 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-48e453c9-fa5a-45a9-97d4-418248aed402 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:12.598498 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-48e453c9-fa5a-45a9-97d4-418248aed402 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:12.599362 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-48e453c9-fa5a-45a9-97d4-418248aed402 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:12.599850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-48e453c9-fa5a-45a9-97d4-418248aed402 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:12.668007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-48e453c9-fa5a-45a9-97d4-418248aed402 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:12.676524 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-48e453c9-fa5a-45a9-97d4-418248aed402 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1271 microversion: 2.1 time: 0.089984 Aug 01 07:40:12.677160 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 199/413] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:12 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:13.356383 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a4a31787-a4e7-4845-9f5f-6bf4ee86852b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:13.356984 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a4a31787-a4e7-4845-9f5f-6bf4ee86852b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:13.364142 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a4a31787-a4e7-4845-9f5f-6bf4ee86852b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:13.364594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a4a31787-a4e7-4845-9f5f-6bf4ee86852b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:13.365353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a4a31787-a4e7-4845-9f5f-6bf4ee86852b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:13.366018 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a4a31787-a4e7-4845-9f5f-6bf4ee86852b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:13.509052 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a4a31787-a4e7-4845-9f5f-6bf4ee86852b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:13.516584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a4a31787-a4e7-4845-9f5f-6bf4ee86852b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.164053 Aug 01 07:40:13.517161 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 215/414] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:13 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:13.536927 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b0b43180-6a43-4229-a7b8-48d24dc84f95 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:13.537639 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b0b43180-6a43-4229-a7b8-48d24dc84f95 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:13.543699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b0b43180-6a43-4229-a7b8-48d24dc84f95 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:13.544152 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b0b43180-6a43-4229-a7b8-48d24dc84f95 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:13.544918 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b0b43180-6a43-4229-a7b8-48d24dc84f95 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:13.545356 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b0b43180-6a43-4229-a7b8-48d24dc84f95 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:13.699637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ba824eff-0673-4006-b11e-97df5454ee9c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:13.701227 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ba824eff-0673-4006-b11e-97df5454ee9c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:13.708710 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba824eff-0673-4006-b11e-97df5454ee9c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:13.709115 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba824eff-0673-4006-b11e-97df5454ee9c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:13.710033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba824eff-0673-4006-b11e-97df5454ee9c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:13.710467 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba824eff-0673-4006-b11e-97df5454ee9c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:13.715776 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:13.789047 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ba824eff-0673-4006-b11e-97df5454ee9c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:13.797163 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ba824eff-0673-4006-b11e-97df5454ee9c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1277 microversion: 2.1 time: 0.101998 Aug 01 07:40:13.798460 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 216/415] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:13 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:14.100314 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b0b43180-6a43-4229-a7b8-48d24dc84f95 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:14.109716 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b0b43180-6a43-4229-a7b8-48d24dc84f95 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:14.112207 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b0b43180-6a43-4229-a7b8-48d24dc84f95 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:14.113905 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b0b43180-6a43-4229-a7b8-48d24dc84f95 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.582920 Aug 01 07:40:14.129156 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 200/416] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:13 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:14.539690 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bdb7bc56-ee0a-4cb4-abed-e729242d1e54 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:14.540219 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-bdb7bc56-ee0a-4cb4-abed-e729242d1e54 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:14.550709 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bdb7bc56-ee0a-4cb4-abed-e729242d1e54 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:14.553542 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bdb7bc56-ee0a-4cb4-abed-e729242d1e54 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:14.554809 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bdb7bc56-ee0a-4cb4-abed-e729242d1e54 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:14.555513 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bdb7bc56-ee0a-4cb4-abed-e729242d1e54 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:14.728763 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bdb7bc56-ee0a-4cb4-abed-e729242d1e54 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:14.737074 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-bdb7bc56-ee0a-4cb4-abed-e729242d1e54 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.201282 Aug 01 07:40:14.737641 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 217/417] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:14 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:14.819565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-881464e0-7e38-468a-9901-e441026a63a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:14.820099 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-881464e0-7e38-468a-9901-e441026a63a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:14.825994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-881464e0-7e38-468a-9901-e441026a63a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:14.826440 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-881464e0-7e38-468a-9901-e441026a63a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:14.827218 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-881464e0-7e38-468a-9901-e441026a63a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:14.827654 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-881464e0-7e38-468a-9901-e441026a63a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:15.140739 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-acf59b7c-6508-4aae-adc5-f7b41d314ad4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:15.141615 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-acf59b7c-6508-4aae-adc5-f7b41d314ad4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:15.147950 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-acf59b7c-6508-4aae-adc5-f7b41d314ad4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:15.148560 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-acf59b7c-6508-4aae-adc5-f7b41d314ad4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:15.149655 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-acf59b7c-6508-4aae-adc5-f7b41d314ad4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:15.150311 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-acf59b7c-6508-4aae-adc5-f7b41d314ad4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:15.263178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-881464e0-7e38-468a-9901-e441026a63a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:15.272980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-881464e0-7e38-468a-9901-e441026a63a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.457436 Aug 01 07:40:15.283528 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 201/418] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:14 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:15.295429 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-acf59b7c-6508-4aae-adc5-f7b41d314ad4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:15.312796 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-acf59b7c-6508-4aae-adc5-f7b41d314ad4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:15.314992 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-acf59b7c-6508-4aae-adc5-f7b41d314ad4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:15.316202 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-acf59b7c-6508-4aae-adc5-f7b41d314ad4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.179532 Aug 01 07:40:15.316757 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 218/419] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:15 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:15.538893 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-0578ca9b-f634-42a1-a616-6eb3cf6d6f71 req-f03e484b-3ec3-4c73-86b0-cbc512183334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454081a2-dd82-4a94-9e68-1133673dbb5d", "tag": "e77df30b-cc0f-41e2-8917-65896ef59884"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:15.593794 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-0578ca9b-f634-42a1-a616-6eb3cf6d6f71 req-f03e484b-3ec3-4c73-86b0-cbc512183334 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:15.595310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-0578ca9b-f634-42a1-a616-6eb3cf6d6f71 req-f03e484b-3ec3-4c73-86b0-cbc512183334 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:15.608029 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-0578ca9b-f634-42a1-a616-6eb3cf6d6f71 req-f03e484b-3ec3-4c73-86b0-cbc512183334 service nova] Creating event network-changed:e77df30b-cc0f-41e2-8917-65896ef59884 for instance 454081a2-dd82-4a94-9e68-1133673dbb5d on hv-cinder-73306 Aug 01 07:40:15.615264 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-0578ca9b-f634-42a1-a616-6eb3cf6d6f71 req-f03e484b-3ec3-4c73-86b0-cbc512183334 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079606 Aug 01 07:40:15.616017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 202/420] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:40:15.760456 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b1013553-92c0-49c9-91e2-4c3831599a3b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:15.761221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b1013553-92c0-49c9-91e2-4c3831599a3b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:15.777742 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1013553-92c0-49c9-91e2-4c3831599a3b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:15.778496 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1013553-92c0-49c9-91e2-4c3831599a3b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:15.779919 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1013553-92c0-49c9-91e2-4c3831599a3b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:15.783617 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1013553-92c0-49c9-91e2-4c3831599a3b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:16.007333 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b1013553-92c0-49c9-91e2-4c3831599a3b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:16.025799 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b1013553-92c0-49c9-91e2-4c3831599a3b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.270775 Aug 01 07:40:16.039047 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 219/421] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:15 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:16.190343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-a8642457-5861-4a73-b371-f9b42a1832cc req-5e4d423b-cdf2-4629-a7b5-206a3c99b951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d", "name": "network-vif-plugged", "status": "completed", "tag": "62003bcf-02f7-4b14-97e3-6fad5084dd62"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:16.209357 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-a8642457-5861-4a73-b371-f9b42a1832cc req-5e4d423b-cdf2-4629-a7b5-206a3c99b951 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:16.210190 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-a8642457-5861-4a73-b371-f9b42a1832cc req-5e4d423b-cdf2-4629-a7b5-206a3c99b951 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:16.214914 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:16.225925 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-a8642457-5861-4a73-b371-f9b42a1832cc req-5e4d423b-cdf2-4629-a7b5-206a3c99b951 service nova] Creating event network-vif-plugged:62003bcf-02f7-4b14-97e3-6fad5084dd62 for instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d on hv-cinder-73306 Aug 01 07:40:16.231968 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-a8642457-5861-4a73-b371-f9b42a1832cc req-5e4d423b-cdf2-4629-a7b5-206a3c99b951 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053665 Aug 01 07:40:16.233916 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 203/422] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:40:16.294112 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-44d5fa00-0e27-4e79-8bc8-14e5ae703f44 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:16.295106 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-44d5fa00-0e27-4e79-8bc8-14e5ae703f44 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:16.303127 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-44d5fa00-0e27-4e79-8bc8-14e5ae703f44 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:16.303592 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-44d5fa00-0e27-4e79-8bc8-14e5ae703f44 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:16.304376 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-44d5fa00-0e27-4e79-8bc8-14e5ae703f44 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:16.304927 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-44d5fa00-0e27-4e79-8bc8-14e5ae703f44 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:16.341559 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-efbc279b-5fbb-456a-bb99-f4ddb47f6728 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:16.342517 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-efbc279b-5fbb-456a-bb99-f4ddb47f6728 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:16.355678 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-efbc279b-5fbb-456a-bb99-f4ddb47f6728 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:16.356463 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-efbc279b-5fbb-456a-bb99-f4ddb47f6728 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:16.357478 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-efbc279b-5fbb-456a-bb99-f4ddb47f6728 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:16.361037 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-efbc279b-5fbb-456a-bb99-f4ddb47f6728 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:16.490507 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-44d5fa00-0e27-4e79-8bc8-14e5ae703f44 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:16.498073 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-44d5fa00-0e27-4e79-8bc8-14e5ae703f44 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.207713 Aug 01 07:40:16.498644 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 220/423] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:16 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:16.534004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-efbc279b-5fbb-456a-bb99-f4ddb47f6728 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:16.546371 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-efbc279b-5fbb-456a-bb99-f4ddb47f6728 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:16.548698 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-efbc279b-5fbb-456a-bb99-f4ddb47f6728 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:16.550070 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-efbc279b-5fbb-456a-bb99-f4ddb47f6728 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.213525 Aug 01 07:40:16.550620 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 204/424] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:16 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:17.046722 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6a5cb168-bf01-4457-8bbc-ef909a499f99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:17.047321 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6a5cb168-bf01-4457-8bbc-ef909a499f99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:17.055952 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6a5cb168-bf01-4457-8bbc-ef909a499f99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:17.056398 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6a5cb168-bf01-4457-8bbc-ef909a499f99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:17.057347 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6a5cb168-bf01-4457-8bbc-ef909a499f99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:17.057811 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6a5cb168-bf01-4457-8bbc-ef909a499f99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:17.301238 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6a5cb168-bf01-4457-8bbc-ef909a499f99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:17.309721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6a5cb168-bf01-4457-8bbc-ef909a499f99 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.267688 Aug 01 07:40:17.310301 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 221/425] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:17 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:17.525548 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-59b57fef-a59f-482d-a59b-1eef5b596035 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:17.526152 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-59b57fef-a59f-482d-a59b-1eef5b596035 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:17.532335 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-59b57fef-a59f-482d-a59b-1eef5b596035 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:17.532785 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-59b57fef-a59f-482d-a59b-1eef5b596035 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:17.534385 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-59b57fef-a59f-482d-a59b-1eef5b596035 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:17.534843 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-59b57fef-a59f-482d-a59b-1eef5b596035 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:17.573038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0e940254-84d2-4a2d-88ef-764e295298e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:17.573644 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0e940254-84d2-4a2d-88ef-764e295298e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:17.575581 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:17.581356 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e940254-84d2-4a2d-88ef-764e295298e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:17.581813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e940254-84d2-4a2d-88ef-764e295298e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:17.582594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e940254-84d2-4a2d-88ef-764e295298e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:17.583033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0e940254-84d2-4a2d-88ef-764e295298e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:17.710009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-59b57fef-a59f-482d-a59b-1eef5b596035 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:17.717872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-59b57fef-a59f-482d-a59b-1eef5b596035 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.196381 Aug 01 07:40:17.718445 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 205/426] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:17 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:17.764636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0e940254-84d2-4a2d-88ef-764e295298e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:17.774482 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0e940254-84d2-4a2d-88ef-764e295298e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:17.776020 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0e940254-84d2-4a2d-88ef-764e295298e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:17.777261 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0e940254-84d2-4a2d-88ef-764e295298e6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.208074 Aug 01 07:40:17.777819 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 222/427] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:17 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:18.341725 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ff310472-eeca-4568-b40d-9ecff9679bb3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:18.342727 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ff310472-eeca-4568-b40d-9ecff9679bb3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:18.351374 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ff310472-eeca-4568-b40d-9ecff9679bb3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:18.351897 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ff310472-eeca-4568-b40d-9ecff9679bb3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:18.352746 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ff310472-eeca-4568-b40d-9ecff9679bb3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:18.353252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ff310472-eeca-4568-b40d-9ecff9679bb3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:18.616236 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ff310472-eeca-4568-b40d-9ecff9679bb3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:18.624874 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ff310472-eeca-4568-b40d-9ecff9679bb3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.294601 Aug 01 07:40:18.625817 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 206/428] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:18 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:18.740835 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e9e177de-42dc-4647-aacf-eb70fbf6e315 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:18.742096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e9e177de-42dc-4647-aacf-eb70fbf6e315 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:18.749895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e9e177de-42dc-4647-aacf-eb70fbf6e315 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:18.750390 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e9e177de-42dc-4647-aacf-eb70fbf6e315 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:18.751397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e9e177de-42dc-4647-aacf-eb70fbf6e315 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:18.752669 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e9e177de-42dc-4647-aacf-eb70fbf6e315 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:18.802213 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-91342cb9-c1db-4515-ad81-e91e59477dd4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:18.803221 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-91342cb9-c1db-4515-ad81-e91e59477dd4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:18.810239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91342cb9-c1db-4515-ad81-e91e59477dd4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:18.810855 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91342cb9-c1db-4515-ad81-e91e59477dd4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:18.812093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91342cb9-c1db-4515-ad81-e91e59477dd4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:18.816450 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91342cb9-c1db-4515-ad81-e91e59477dd4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:18.913984 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e9e177de-42dc-4647-aacf-eb70fbf6e315 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:18.922200 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e9e177de-42dc-4647-aacf-eb70fbf6e315 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.185169 Aug 01 07:40:18.923081 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 223/429] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:18 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:18.974330 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-91342cb9-c1db-4515-ad81-e91e59477dd4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:18.983007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-91342cb9-c1db-4515-ad81-e91e59477dd4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:18.984621 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-91342cb9-c1db-4515-ad81-e91e59477dd4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:18.985768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-91342cb9-c1db-4515-ad81-e91e59477dd4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.187937 Aug 01 07:40:18.987132 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 207/430] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:18 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:19.652344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9438fddb-7249-4f34-9d37-76aa14be4adf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:19.652972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9438fddb-7249-4f34-9d37-76aa14be4adf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:19.677252 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9438fddb-7249-4f34-9d37-76aa14be4adf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:19.677709 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9438fddb-7249-4f34-9d37-76aa14be4adf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:19.678502 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9438fddb-7249-4f34-9d37-76aa14be4adf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:19.678945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9438fddb-7249-4f34-9d37-76aa14be4adf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:19.825767 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9438fddb-7249-4f34-9d37-76aa14be4adf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:19.834633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9438fddb-7249-4f34-9d37-76aa14be4adf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.186115 Aug 01 07:40:19.835577 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 224/431] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:19 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:19.945386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-843af0d4-0955-487c-99ce-a7aa0e2ad8ed tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:19.945983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-843af0d4-0955-487c-99ce-a7aa0e2ad8ed tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:19.952484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-843af0d4-0955-487c-99ce-a7aa0e2ad8ed tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:19.952936 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-843af0d4-0955-487c-99ce-a7aa0e2ad8ed tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:19.953709 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-843af0d4-0955-487c-99ce-a7aa0e2ad8ed tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:19.954145 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-843af0d4-0955-487c-99ce-a7aa0e2ad8ed tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:20.010048 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5bf05fc8-7db4-4def-8036-091738a3cf7f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:20.015261 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5bf05fc8-7db4-4def-8036-091738a3cf7f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:20.024756 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf05fc8-7db4-4def-8036-091738a3cf7f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:20.025646 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf05fc8-7db4-4def-8036-091738a3cf7f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:20.026563 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf05fc8-7db4-4def-8036-091738a3cf7f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:20.027271 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf05fc8-7db4-4def-8036-091738a3cf7f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:20.117008 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-843af0d4-0955-487c-99ce-a7aa0e2ad8ed tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:20.124286 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-843af0d4-0955-487c-99ce-a7aa0e2ad8ed tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.182864 Aug 01 07:40:20.124882 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 208/432] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:19 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:20.179784 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5bf05fc8-7db4-4def-8036-091738a3cf7f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:20.188098 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5bf05fc8-7db4-4def-8036-091738a3cf7f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:20.190370 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5bf05fc8-7db4-4def-8036-091738a3cf7f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:20.191567 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5bf05fc8-7db4-4def-8036-091738a3cf7f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.185510 Aug 01 07:40:20.192146 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 225/433] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:20 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:20.856962 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-daa7b3a6-a86a-4f3b-9bd1-9667b1d19c68 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:20.857570 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-daa7b3a6-a86a-4f3b-9bd1-9667b1d19c68 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:20.864088 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-daa7b3a6-a86a-4f3b-9bd1-9667b1d19c68 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:20.864552 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-daa7b3a6-a86a-4f3b-9bd1-9667b1d19c68 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:20.865479 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-daa7b3a6-a86a-4f3b-9bd1-9667b1d19c68 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:20.866229 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-daa7b3a6-a86a-4f3b-9bd1-9667b1d19c68 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:21.038761 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-daa7b3a6-a86a-4f3b-9bd1-9667b1d19c68 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:21.047762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-daa7b3a6-a86a-4f3b-9bd1-9667b1d19c68 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.194911 Aug 01 07:40:21.049635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 209/434] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:20 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:21.145767 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1d045ffe-0bf2-493c-a213-e18286638957 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:21.146766 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1d045ffe-0bf2-493c-a213-e18286638957 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:21.153562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d045ffe-0bf2-493c-a213-e18286638957 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:21.154071 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d045ffe-0bf2-493c-a213-e18286638957 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:21.154842 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d045ffe-0bf2-493c-a213-e18286638957 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:21.155312 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d045ffe-0bf2-493c-a213-e18286638957 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:21.216122 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-afb4780a-2100-4b24-ac79-71d12de961d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:21.217989 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-afb4780a-2100-4b24-ac79-71d12de961d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:21.226512 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-afb4780a-2100-4b24-ac79-71d12de961d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:21.227119 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-afb4780a-2100-4b24-ac79-71d12de961d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:21.228031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-afb4780a-2100-4b24-ac79-71d12de961d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:21.228987 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-afb4780a-2100-4b24-ac79-71d12de961d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:21.338136 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1d045ffe-0bf2-493c-a213-e18286638957 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:21.348141 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1d045ffe-0bf2-493c-a213-e18286638957 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.206120 Aug 01 07:40:21.349293 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 226/435] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:21 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:21.400786 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-afb4780a-2100-4b24-ac79-71d12de961d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:21.410634 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-afb4780a-2100-4b24-ac79-71d12de961d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:21.413335 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-afb4780a-2100-4b24-ac79-71d12de961d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:21.414530 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-afb4780a-2100-4b24-ac79-71d12de961d3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.203651 Aug 01 07:40:21.415117 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 210/436] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:21 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:22.072838 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0783d4d5-cd7f-47d0-a766-741f7c3bc18c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:22.073448 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0783d4d5-cd7f-47d0-a766-741f7c3bc18c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:22.075316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:22.081565 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0783d4d5-cd7f-47d0-a766-741f7c3bc18c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:22.081952 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0783d4d5-cd7f-47d0-a766-741f7c3bc18c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:22.082732 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0783d4d5-cd7f-47d0-a766-741f7c3bc18c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:22.083196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0783d4d5-cd7f-47d0-a766-741f7c3bc18c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:22.220707 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0783d4d5-cd7f-47d0-a766-741f7c3bc18c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:22.228260 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0783d4d5-cd7f-47d0-a766-741f7c3bc18c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.159398 Aug 01 07:40:22.228821 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 227/437] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:22 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:22.383565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-84547f1d-f005-4bda-97fa-d915798b26aa tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:22.383565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-84547f1d-f005-4bda-97fa-d915798b26aa tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:22.385717 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=4 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:22.386607 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=14 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:22.393293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-84547f1d-f005-4bda-97fa-d915798b26aa tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:22.393753 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-84547f1d-f005-4bda-97fa-d915798b26aa tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:22.394591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-84547f1d-f005-4bda-97fa-d915798b26aa tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:22.395017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-84547f1d-f005-4bda-97fa-d915798b26aa tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:22.441821 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a6d13756-61e9-46a7-8f37-8eaa5f843283 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:22.442429 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a6d13756-61e9-46a7-8f37-8eaa5f843283 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:22.448403 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a6d13756-61e9-46a7-8f37-8eaa5f843283 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:22.448850 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a6d13756-61e9-46a7-8f37-8eaa5f843283 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:22.449608 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a6d13756-61e9-46a7-8f37-8eaa5f843283 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:22.450038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a6d13756-61e9-46a7-8f37-8eaa5f843283 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:22.526711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-84547f1d-f005-4bda-97fa-d915798b26aa tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:22.535148 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-84547f1d-f005-4bda-97fa-d915798b26aa tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.167175 Aug 01 07:40:22.536183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 211/438] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:22 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:22.592346 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a6d13756-61e9-46a7-8f37-8eaa5f843283 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:22.602159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a6d13756-61e9-46a7-8f37-8eaa5f843283 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:22.603798 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a6d13756-61e9-46a7-8f37-8eaa5f843283 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:22.604971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a6d13756-61e9-46a7-8f37-8eaa5f843283 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.167822 Aug 01 07:40:22.605531 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 228/439] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:22 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:23.249999 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2b0520c3-8312-4805-b0f9-f5f4360a5462 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:23.250548 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2b0520c3-8312-4805-b0f9-f5f4360a5462 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:23.257937 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2b0520c3-8312-4805-b0f9-f5f4360a5462 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:23.258515 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2b0520c3-8312-4805-b0f9-f5f4360a5462 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:23.260051 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2b0520c3-8312-4805-b0f9-f5f4360a5462 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:23.260622 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2b0520c3-8312-4805-b0f9-f5f4360a5462 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:23.403337 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2b0520c3-8312-4805-b0f9-f5f4360a5462 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:23.411275 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2b0520c3-8312-4805-b0f9-f5f4360a5462 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.165103 Aug 01 07:40:23.411844 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 212/440] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:23 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:23.557831 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1e68befe-c79d-4f99-bfbd-88ab89abb5db tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:23.558408 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1e68befe-c79d-4f99-bfbd-88ab89abb5db tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:23.566213 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1e68befe-c79d-4f99-bfbd-88ab89abb5db tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:23.566663 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1e68befe-c79d-4f99-bfbd-88ab89abb5db tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:23.567467 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1e68befe-c79d-4f99-bfbd-88ab89abb5db tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:23.567946 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1e68befe-c79d-4f99-bfbd-88ab89abb5db tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:23.631060 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8dbaccda-e639-4206-b844-a4ee26c064bd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:23.631696 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8dbaccda-e639-4206-b844-a4ee26c064bd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:23.645345 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8dbaccda-e639-4206-b844-a4ee26c064bd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:23.646090 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8dbaccda-e639-4206-b844-a4ee26c064bd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:23.650910 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8dbaccda-e639-4206-b844-a4ee26c064bd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:23.651486 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8dbaccda-e639-4206-b844-a4ee26c064bd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:23.735365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1e68befe-c79d-4f99-bfbd-88ab89abb5db tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:23.753197 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1e68befe-c79d-4f99-bfbd-88ab89abb5db tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.199056 Aug 01 07:40:23.756131 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 229/441] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:23 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:23.826277 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8dbaccda-e639-4206-b844-a4ee26c064bd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:23.836761 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8dbaccda-e639-4206-b844-a4ee26c064bd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:23.838682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8dbaccda-e639-4206-b844-a4ee26c064bd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:23.840687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8dbaccda-e639-4206-b844-a4ee26c064bd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.214682 Aug 01 07:40:23.841865 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 213/442] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:23 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:24.432381 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7c4b9021-4f76-441a-ab40-f311c90146e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:24.432987 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7c4b9021-4f76-441a-ab40-f311c90146e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:24.440007 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7c4b9021-4f76-441a-ab40-f311c90146e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:24.440607 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7c4b9021-4f76-441a-ab40-f311c90146e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:24.441373 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7c4b9021-4f76-441a-ab40-f311c90146e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:24.441805 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7c4b9021-4f76-441a-ab40-f311c90146e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:24.587658 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7c4b9021-4f76-441a-ab40-f311c90146e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:24.596863 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7c4b9021-4f76-441a-ab40-f311c90146e4 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.168288 Aug 01 07:40:24.597529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 230/443] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:24 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:24.773771 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c7bddbc6-a0e0-438f-91a2-1e8c4da60ab3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:24.774386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c7bddbc6-a0e0-438f-91a2-1e8c4da60ab3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:24.780509 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7bddbc6-a0e0-438f-91a2-1e8c4da60ab3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:24.780965 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7bddbc6-a0e0-438f-91a2-1e8c4da60ab3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:24.781737 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7bddbc6-a0e0-438f-91a2-1e8c4da60ab3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:24.782178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c7bddbc6-a0e0-438f-91a2-1e8c4da60ab3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:24.870313 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b2751a1d-052b-44c6-81c9-ff4696974270 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:24.870953 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b2751a1d-052b-44c6-81c9-ff4696974270 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:24.877891 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b2751a1d-052b-44c6-81c9-ff4696974270 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:24.878344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b2751a1d-052b-44c6-81c9-ff4696974270 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:24.879400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b2751a1d-052b-44c6-81c9-ff4696974270 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:24.879836 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b2751a1d-052b-44c6-81c9-ff4696974270 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:24.939805 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c7bddbc6-a0e0-438f-91a2-1e8c4da60ab3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:24.951327 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c7bddbc6-a0e0-438f-91a2-1e8c4da60ab3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.181289 Aug 01 07:40:24.966841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 214/444] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:24 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:25.040648 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b2751a1d-052b-44c6-81c9-ff4696974270 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:25.061795 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b2751a1d-052b-44c6-81c9-ff4696974270 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:25.063673 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b2751a1d-052b-44c6-81c9-ff4696974270 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:25.065478 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b2751a1d-052b-44c6-81c9-ff4696974270 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.204734 Aug 01 07:40:25.066183 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 231/445] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:24 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:25.618045 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ec685334-4954-47a5-a87a-c9b8a804f95a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:25.618648 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ec685334-4954-47a5-a87a-c9b8a804f95a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:25.624804 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ec685334-4954-47a5-a87a-c9b8a804f95a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:25.625247 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ec685334-4954-47a5-a87a-c9b8a804f95a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:25.626025 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ec685334-4954-47a5-a87a-c9b8a804f95a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:25.626786 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ec685334-4954-47a5-a87a-c9b8a804f95a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:25.790633 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ec685334-4954-47a5-a87a-c9b8a804f95a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:25.799400 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ec685334-4954-47a5-a87a-c9b8a804f95a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.184216 Aug 01 07:40:25.800143 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 215/446] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:25 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:25.974500 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-57ea417e-fac5-4559-99b8-a34a7e0dc69f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:25.975040 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-57ea417e-fac5-4559-99b8-a34a7e0dc69f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:25.981647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57ea417e-fac5-4559-99b8-a34a7e0dc69f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:25.981968 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57ea417e-fac5-4559-99b8-a34a7e0dc69f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:25.982726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57ea417e-fac5-4559-99b8-a34a7e0dc69f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:25.983182 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57ea417e-fac5-4559-99b8-a34a7e0dc69f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:26.088826 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-34a58875-90f0-49e2-a255-94ff9b14c2f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:26.089432 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-34a58875-90f0-49e2-a255-94ff9b14c2f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:26.095727 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34a58875-90f0-49e2-a255-94ff9b14c2f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:26.096316 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34a58875-90f0-49e2-a255-94ff9b14c2f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:26.097089 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34a58875-90f0-49e2-a255-94ff9b14c2f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:26.097530 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34a58875-90f0-49e2-a255-94ff9b14c2f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:26.112683 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-57ea417e-fac5-4559-99b8-a34a7e0dc69f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:26.116271 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=100 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:26.121637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-57ea417e-fac5-4559-99b8-a34a7e0dc69f tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.151667 Aug 01 07:40:26.122215 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 232/447] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:25 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:26.227166 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-34a58875-90f0-49e2-a255-94ff9b14c2f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:26.235529 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-34a58875-90f0-49e2-a255-94ff9b14c2f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:26.237938 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-34a58875-90f0-49e2-a255-94ff9b14c2f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:26.239123 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-34a58875-90f0-49e2-a255-94ff9b14c2f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.154341 Aug 01 07:40:26.239707 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 216/448] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:26 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:26.820430 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5e6188e9-aab7-4efb-916b-82ce53782516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:26.821013 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5e6188e9-aab7-4efb-916b-82ce53782516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:26.826855 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5e6188e9-aab7-4efb-916b-82ce53782516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:26.827335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5e6188e9-aab7-4efb-916b-82ce53782516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:26.828098 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5e6188e9-aab7-4efb-916b-82ce53782516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:26.828533 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5e6188e9-aab7-4efb-916b-82ce53782516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:26.967656 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5e6188e9-aab7-4efb-916b-82ce53782516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:26.976210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5e6188e9-aab7-4efb-916b-82ce53782516 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.159731 Aug 01 07:40:26.976761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 233/449] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:26 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:27.144347 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-554eb40c-db61-4823-85f9-dc818d171fd2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:27.144882 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-554eb40c-db61-4823-85f9-dc818d171fd2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:27.150821 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-554eb40c-db61-4823-85f9-dc818d171fd2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:27.151304 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-554eb40c-db61-4823-85f9-dc818d171fd2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:27.152054 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-554eb40c-db61-4823-85f9-dc818d171fd2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:27.152485 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-554eb40c-db61-4823-85f9-dc818d171fd2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:27.263425 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-fa39e3db-047e-41db-9b68-589f56ef8165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:27.264027 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-fa39e3db-047e-41db-9b68-589f56ef8165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:27.271189 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fa39e3db-047e-41db-9b68-589f56ef8165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:27.271638 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fa39e3db-047e-41db-9b68-589f56ef8165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:27.272399 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fa39e3db-047e-41db-9b68-589f56ef8165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:27.272827 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fa39e3db-047e-41db-9b68-589f56ef8165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:27.279639 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-554eb40c-db61-4823-85f9-dc818d171fd2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:27.287080 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-554eb40c-db61-4823-85f9-dc818d171fd2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.147338 Aug 01 07:40:27.287641 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 217/450] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:27 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:27.405978 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fa39e3db-047e-41db-9b68-589f56ef8165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:27.415481 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fa39e3db-047e-41db-9b68-589f56ef8165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:27.417118 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fa39e3db-047e-41db-9b68-589f56ef8165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:27.418773 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-fa39e3db-047e-41db-9b68-589f56ef8165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.159167 Aug 01 07:40:27.420459 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 234/451] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:27 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:27.996428 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-13936500-83f7-4072-80de-f0802bed3357 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:27.997032 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-13936500-83f7-4072-80de-f0802bed3357 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:28.003350 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13936500-83f7-4072-80de-f0802bed3357 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:28.004068 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13936500-83f7-4072-80de-f0802bed3357 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:28.004880 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13936500-83f7-4072-80de-f0802bed3357 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:28.005322 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13936500-83f7-4072-80de-f0802bed3357 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:28.042456 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-484863982", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1723413518", "security_groups": [{"name": "tempest-secgroup-smoke-1404206193"}], "block_device_mapping_v2": [{"uuid": "b6263c66-b6af-40bf-bf06-d273536592ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eaaa6e09-856c-4518-bc1e-d02d9efafed7"}]}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:28.143457 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-13936500-83f7-4072-80de-f0802bed3357 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:28.150990 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-13936500-83f7-4072-80de-f0802bed3357 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1369 microversion: 2.1 time: 0.158383 Aug 01 07:40:28.152263 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 218/452] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:27 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:28.167042 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.network.neutron [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] validate_networks() for [('eaaa6e09-856c-4518-bc1e-d02d9efafed7', None, None, None, None, None)] {{(pid=124279) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:40:28.307437 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5ec677c9-7c3c-4ceb-8e86-2f200e4a1192 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:28.308181 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5ec677c9-7c3c-4ceb-8e86-2f200e4a1192 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:28.314701 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ec677c9-7c3c-4ceb-8e86-2f200e4a1192 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:28.315283 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ec677c9-7c3c-4ceb-8e86-2f200e4a1192 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:28.316131 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ec677c9-7c3c-4ceb-8e86-2f200e4a1192 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:28.316805 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ec677c9-7c3c-4ceb-8e86-2f200e4a1192 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:28.496888 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5ec677c9-7c3c-4ceb-8e86-2f200e4a1192 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:28.506381 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5ec677c9-7c3c-4ceb-8e86-2f200e4a1192 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.202547 Aug 01 07:40:28.507093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 219/453] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:28 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:28.513261 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7eb3004b-cad7-45e4-9a33-11d7c9b0de29 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:28.514131 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7eb3004b-cad7-45e4-9a33-11d7c9b0de29 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:28.521313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7eb3004b-cad7-45e4-9a33-11d7c9b0de29 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:28.521769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7eb3004b-cad7-45e4-9a33-11d7c9b0de29 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:28.522552 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7eb3004b-cad7-45e4-9a33-11d7c9b0de29 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:28.522994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7eb3004b-cad7-45e4-9a33-11d7c9b0de29 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:28.543132 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:28.580411 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Flavor limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:40:28.580980 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Image limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:40:28.581450 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Flavor pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:40:28.581868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Image pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:40:28.582313 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:40:28.591447 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:28.592164 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:28.592977 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:28.593418 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:28.613180 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Getting quotas for project 810069989cfb42799139be8ec2423288. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:40:28.620576 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Getting quotas for user 890be2e19b43473caa79b2dc889f8436 and project 810069989cfb42799139be8ec2423288. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:40:28.675407 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7eb3004b-cad7-45e4-9a33-11d7c9b0de29 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:28.684881 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Going to run 1 instances... {{(pid=124279) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:40:28.686768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7eb3004b-cad7-45e4-9a33-11d7c9b0de29 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:28.686931 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6263c66-b6af-40bf-bf06-d273536592ff',volume_size=None,volume_type=None)] {{(pid=124279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:40:28.688700 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7eb3004b-cad7-45e4-9a33-11d7c9b0de29 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:28.690180 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7eb3004b-cad7-45e4-9a33-11d7c9b0de29 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.181714 Aug 01 07:40:28.690836 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 220/454] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:28 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:28.825761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-73f1a4aa-32ef-4cc7-adc4-d4e2e34d98fc tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787046 Aug 01 07:40:28.826412 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 235/455] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:40:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 07:40:28.839626 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e6c3a36a-9826-4590-afdc-05b9a8af2da4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:28.839852 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e6c3a36a-9826-4590-afdc-05b9a8af2da4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:28.900427 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e6c3a36a-9826-4590-afdc-05b9a8af2da4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:28.908900 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e6c3a36a-9826-4590-afdc-05b9a8af2da4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1094 microversion: 2.1 time: 0.074644 Aug 01 07:40:28.909488 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 221/456] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:28 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:29.174785 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6e07ea10-8111-495e-8b5b-4f3752dc5eb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:29.176180 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6e07ea10-8111-495e-8b5b-4f3752dc5eb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:29.184091 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6e07ea10-8111-495e-8b5b-4f3752dc5eb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:29.184865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6e07ea10-8111-495e-8b5b-4f3752dc5eb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:29.185807 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6e07ea10-8111-495e-8b5b-4f3752dc5eb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:29.186472 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6e07ea10-8111-495e-8b5b-4f3752dc5eb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:29.342662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6e07ea10-8111-495e-8b5b-4f3752dc5eb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:29.352138 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6e07ea10-8111-495e-8b5b-4f3752dc5eb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1562 microversion: 2.1 time: 0.183335 Aug 01 07:40:29.352754 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 236/457] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:29 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1562 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:29.373614 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fe69ad09-aa98-476b-b1ce-5dd72cce86db tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:29.374133 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fe69ad09-aa98-476b-b1ce-5dd72cce86db tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:29.381364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe69ad09-aa98-476b-b1ce-5dd72cce86db tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:29.381890 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe69ad09-aa98-476b-b1ce-5dd72cce86db tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:29.382725 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe69ad09-aa98-476b-b1ce-5dd72cce86db tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:29.383436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe69ad09-aa98-476b-b1ce-5dd72cce86db tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:29.482845 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fe69ad09-aa98-476b-b1ce-5dd72cce86db tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112844 Aug 01 07:40:29.483216 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 222/458] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 1 07:40:29 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:40:29.528031 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0f58af8b-6c94-4b52-8958-c5bc41fcd7a7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:29.528663 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0f58af8b-6c94-4b52-8958-c5bc41fcd7a7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:29.547516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0f58af8b-6c94-4b52-8958-c5bc41fcd7a7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:29.550454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0f58af8b-6c94-4b52-8958-c5bc41fcd7a7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:29.551506 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0f58af8b-6c94-4b52-8958-c5bc41fcd7a7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:29.552354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0f58af8b-6c94-4b52-8958-c5bc41fcd7a7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:29.713273 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6cd9cbde-ee2a-4aa9-86d1-e5494038642e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:29.713884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6cd9cbde-ee2a-4aa9-86d1-e5494038642e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:29.721744 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6cd9cbde-ee2a-4aa9-86d1-e5494038642e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:29.722455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6cd9cbde-ee2a-4aa9-86d1-e5494038642e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:29.723437 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6cd9cbde-ee2a-4aa9-86d1-e5494038642e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:29.724206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6cd9cbde-ee2a-4aa9-86d1-e5494038642e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:29.727857 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0f58af8b-6c94-4b52-8958-c5bc41fcd7a7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:29.739108 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0f58af8b-6c94-4b52-8958-c5bc41fcd7a7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.214992 Aug 01 07:40:29.745726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 237/459] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:29 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:29.932327 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7f90b8ba-22a8-49a2-a940-b4f913e14abe tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:29.933082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7f90b8ba-22a8-49a2-a940-b4f913e14abe tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:29.941046 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f90b8ba-22a8-49a2-a940-b4f913e14abe tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:29.941493 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f90b8ba-22a8-49a2-a940-b4f913e14abe tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:29.942302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f90b8ba-22a8-49a2-a940-b4f913e14abe tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:29.942920 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f90b8ba-22a8-49a2-a940-b4f913e14abe tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:30.019104 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7f90b8ba-22a8-49a2-a940-b4f913e14abe tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:30.028368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7f90b8ba-22a8-49a2-a940-b4f913e14abe tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1192 microversion: 2.1 time: 0.102456 Aug 01 07:40:30.029158 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 238/460] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:29 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:30.169981 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6cd9cbde-ee2a-4aa9-86d1-e5494038642e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:30.179262 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6cd9cbde-ee2a-4aa9-86d1-e5494038642e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:30.181257 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6cd9cbde-ee2a-4aa9-86d1-e5494038642e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:30.182650 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6cd9cbde-ee2a-4aa9-86d1-e5494038642e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.473346 Aug 01 07:40:30.195634 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 223/461] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:29 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:30.761778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3e9f6df1-ee5e-45f8-904a-9d5849c623c3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:30.763214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3e9f6df1-ee5e-45f8-904a-9d5849c623c3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:30.772463 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3e9f6df1-ee5e-45f8-904a-9d5849c623c3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:30.773082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3e9f6df1-ee5e-45f8-904a-9d5849c623c3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:30.773869 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3e9f6df1-ee5e-45f8-904a-9d5849c623c3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:30.774370 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3e9f6df1-ee5e-45f8-904a-9d5849c623c3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:30.909054 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3e9f6df1-ee5e-45f8-904a-9d5849c623c3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:30.916680 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3e9f6df1-ee5e-45f8-904a-9d5849c623c3 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.158733 Aug 01 07:40:30.917587 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 239/462] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:30 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:31.050007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-30e9b047-ba44-4e63-a086-33e751f0e3f4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:31.050541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-30e9b047-ba44-4e63-a086-33e751f0e3f4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:31.056619 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-30e9b047-ba44-4e63-a086-33e751f0e3f4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:31.057279 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-30e9b047-ba44-4e63-a086-33e751f0e3f4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:31.058068 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-30e9b047-ba44-4e63-a086-33e751f0e3f4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:31.058672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-30e9b047-ba44-4e63-a086-33e751f0e3f4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:31.203848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-30e9b047-ba44-4e63-a086-33e751f0e3f4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:31.208300 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a1428823-3428-4ac4-869f-1887d69e384c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:31.209050 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a1428823-3428-4ac4-869f-1887d69e384c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:31.213021 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-30e9b047-ba44-4e63-a086-33e751f0e3f4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1210 microversion: 2.1 time: 0.167084 Aug 01 07:40:31.213800 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 224/463] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:31 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1210 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:31.227097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1428823-3428-4ac4-869f-1887d69e384c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:31.227097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1428823-3428-4ac4-869f-1887d69e384c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:31.227097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1428823-3428-4ac4-869f-1887d69e384c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:31.227097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1428823-3428-4ac4-869f-1887d69e384c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:31.386912 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-4e906f06-776f-45a6-88ad-f28e19951c79 req-886949bf-a624-4573-9d77-5bdafb25d8ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d", "tag": "62003bcf-02f7-4b14-97e3-6fad5084dd62"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:31.399287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-4e906f06-776f-45a6-88ad-f28e19951c79 req-886949bf-a624-4573-9d77-5bdafb25d8ec service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:31.400188 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-4e906f06-776f-45a6-88ad-f28e19951c79 req-886949bf-a624-4573-9d77-5bdafb25d8ec service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:31.414540 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-4e906f06-776f-45a6-88ad-f28e19951c79 req-886949bf-a624-4573-9d77-5bdafb25d8ec service nova] Creating event network-changed:62003bcf-02f7-4b14-97e3-6fad5084dd62 for instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d on hv-cinder-73306 Aug 01 07:40:31.420900 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-4e906f06-776f-45a6-88ad-f28e19951c79 req-886949bf-a624-4573-9d77-5bdafb25d8ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047490 Aug 01 07:40:31.423478 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 225/464] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:40:31.556987 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a1428823-3428-4ac4-869f-1887d69e384c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:31.566693 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a1428823-3428-4ac4-869f-1887d69e384c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:31.568337 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a1428823-3428-4ac4-869f-1887d69e384c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:31.569713 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a1428823-3428-4ac4-869f-1887d69e384c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.366068 Aug 01 07:40:31.582006 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 240/465] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:31 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:31.940567 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cfa7ecf1-9a5c-4c87-bbe5-b30d0879f9ab tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:31.941324 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-cfa7ecf1-9a5c-4c87-bbe5-b30d0879f9ab tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:31.957388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cfa7ecf1-9a5c-4c87-bbe5-b30d0879f9ab tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:31.958131 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cfa7ecf1-9a5c-4c87-bbe5-b30d0879f9ab tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:31.959217 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cfa7ecf1-9a5c-4c87-bbe5-b30d0879f9ab tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:31.959999 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cfa7ecf1-9a5c-4c87-bbe5-b30d0879f9ab tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:32.237540 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8d3a472b-230c-4430-9d2b-699ea20a3650 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:32.238230 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8d3a472b-230c-4430-9d2b-699ea20a3650 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:32.245825 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8d3a472b-230c-4430-9d2b-699ea20a3650 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:32.246512 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8d3a472b-230c-4430-9d2b-699ea20a3650 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:32.247707 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8d3a472b-230c-4430-9d2b-699ea20a3650 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:32.248720 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8d3a472b-230c-4430-9d2b-699ea20a3650 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:32.250037 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-cfa7ecf1-9a5c-4c87-bbe5-b30d0879f9ab tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:32.263104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-cfa7ecf1-9a5c-4c87-bbe5-b30d0879f9ab tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.328686 Aug 01 07:40:32.264122 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 226/466] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:31 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:32.401332 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8d3a472b-230c-4430-9d2b-699ea20a3650 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:32.410368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8d3a472b-230c-4430-9d2b-699ea20a3650 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.178058 Aug 01 07:40:32.424192 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 241/467] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:32 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:32.509696 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-36400459-b73c-438e-b28b-9e0554e6e05d req-b6ba3be7-f2a7-4b2d-a7bc-530950a1fabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454081a2-dd82-4a94-9e68-1133673dbb5d", "name": "network-vif-plugged", "status": "completed", "tag": "e77df30b-cc0f-41e2-8917-65896ef59884"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:32.519598 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-36400459-b73c-438e-b28b-9e0554e6e05d req-b6ba3be7-f2a7-4b2d-a7bc-530950a1fabf service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:32.520467 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-36400459-b73c-438e-b28b-9e0554e6e05d req-b6ba3be7-f2a7-4b2d-a7bc-530950a1fabf service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:32.534273 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-36400459-b73c-438e-b28b-9e0554e6e05d req-b6ba3be7-f2a7-4b2d-a7bc-530950a1fabf service nova] Creating event network-vif-plugged:e77df30b-cc0f-41e2-8917-65896ef59884 for instance 454081a2-dd82-4a94-9e68-1133673dbb5d on hv-cinder-73306 Aug 01 07:40:32.545621 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-36400459-b73c-438e-b28b-9e0554e6e05d req-b6ba3be7-f2a7-4b2d-a7bc-530950a1fabf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039505 Aug 01 07:40:32.546230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 227/468] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:40:32.593555 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0af77bb3-c1a7-48a2-b9ed-bc91e91352f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:32.594567 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0af77bb3-c1a7-48a2-b9ed-bc91e91352f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:32.602461 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0af77bb3-c1a7-48a2-b9ed-bc91e91352f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:32.602902 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0af77bb3-c1a7-48a2-b9ed-bc91e91352f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:32.603750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0af77bb3-c1a7-48a2-b9ed-bc91e91352f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:32.604133 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0af77bb3-c1a7-48a2-b9ed-bc91e91352f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:32.757858 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0af77bb3-c1a7-48a2-b9ed-bc91e91352f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:32.766401 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0af77bb3-c1a7-48a2-b9ed-bc91e91352f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:32.768694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0af77bb3-c1a7-48a2-b9ed-bc91e91352f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:32.769931 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0af77bb3-c1a7-48a2-b9ed-bc91e91352f6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.180483 Aug 01 07:40:32.770488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 242/469] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:32 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:33.285512 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-169015c9-8519-4f61-aecd-69fa1bcceab8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:33.286202 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-169015c9-8519-4f61-aecd-69fa1bcceab8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:33.292387 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-169015c9-8519-4f61-aecd-69fa1bcceab8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:33.292842 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-169015c9-8519-4f61-aecd-69fa1bcceab8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:33.293593 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-169015c9-8519-4f61-aecd-69fa1bcceab8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:33.294026 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-169015c9-8519-4f61-aecd-69fa1bcceab8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:33.425226 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-169015c9-8519-4f61-aecd-69fa1bcceab8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:33.431516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-17a43667-0819-4155-8d59-b0463dce10d9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:33.432124 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-17a43667-0819-4155-8d59-b0463dce10d9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:33.433278 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-169015c9-8519-4f61-aecd-69fa1bcceab8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.152568 Aug 01 07:40:33.433847 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 228/470] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:33 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:33.438260 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-f4ad642a-09a4-48b5-9c31-ddc591bd9249 req-6f7fdaca-5731-4c87-b6bb-5a536a454a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb", "tag": "ff25bf32-73a3-4dbc-8956-4b8f21c3165b"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:33.438885 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-17a43667-0819-4155-8d59-b0463dce10d9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:33.439371 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-17a43667-0819-4155-8d59-b0463dce10d9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:33.440132 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-17a43667-0819-4155-8d59-b0463dce10d9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:33.440567 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-17a43667-0819-4155-8d59-b0463dce10d9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:33.448449 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-f4ad642a-09a4-48b5-9c31-ddc591bd9249 req-6f7fdaca-5731-4c87-b6bb-5a536a454a5e service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:33.448901 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-f4ad642a-09a4-48b5-9c31-ddc591bd9249 req-6f7fdaca-5731-4c87-b6bb-5a536a454a5e service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:33.460007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-f4ad642a-09a4-48b5-9c31-ddc591bd9249 req-6f7fdaca-5731-4c87-b6bb-5a536a454a5e service nova] Creating event network-changed:ff25bf32-73a3-4dbc-8956-4b8f21c3165b for instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb on hv-cinder-73306 Aug 01 07:40:33.464672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-f4ad642a-09a4-48b5-9c31-ddc591bd9249 req-6f7fdaca-5731-4c87-b6bb-5a536a454a5e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029679 Aug 01 07:40:33.465253 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 229/471] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:40:33.575054 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-17a43667-0819-4155-8d59-b0463dce10d9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:33.583594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-17a43667-0819-4155-8d59-b0463dce10d9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.155806 Aug 01 07:40:33.584158 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 243/472] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:33 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:33.794335 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e991d003-8109-45a9-8e3b-39d78f2539d2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:33.794959 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e991d003-8109-45a9-8e3b-39d78f2539d2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:33.801389 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e991d003-8109-45a9-8e3b-39d78f2539d2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:33.801872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e991d003-8109-45a9-8e3b-39d78f2539d2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:33.802630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e991d003-8109-45a9-8e3b-39d78f2539d2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:33.803084 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e991d003-8109-45a9-8e3b-39d78f2539d2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:33.929847 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e991d003-8109-45a9-8e3b-39d78f2539d2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:33.938253 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e991d003-8109-45a9-8e3b-39d78f2539d2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:33.940311 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e991d003-8109-45a9-8e3b-39d78f2539d2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:33.941459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e991d003-8109-45a9-8e3b-39d78f2539d2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.151493 Aug 01 07:40:33.942008 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 230/473] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:33 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:34.453731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4b2d495d-b779-40aa-adb6-f0303fb448a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:34.454335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4b2d495d-b779-40aa-adb6-f0303fb448a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:34.461067 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4b2d495d-b779-40aa-adb6-f0303fb448a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:34.461516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4b2d495d-b779-40aa-adb6-f0303fb448a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:34.462267 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4b2d495d-b779-40aa-adb6-f0303fb448a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:34.462697 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4b2d495d-b779-40aa-adb6-f0303fb448a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:34.596372 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4b2d495d-b779-40aa-adb6-f0303fb448a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:34.603888 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4b2d495d-b779-40aa-adb6-f0303fb448a2 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.153987 Aug 01 07:40:34.604446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 244/474] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:34 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:34.604725 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-911386c7-9965-4f30-8ba3-3ee97f36a684 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:34.605303 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-911386c7-9965-4f30-8ba3-3ee97f36a684 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:34.612059 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-911386c7-9965-4f30-8ba3-3ee97f36a684 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:34.612587 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-911386c7-9965-4f30-8ba3-3ee97f36a684 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:34.613424 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-911386c7-9965-4f30-8ba3-3ee97f36a684 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:34.613944 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-911386c7-9965-4f30-8ba3-3ee97f36a684 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:34.742421 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-911386c7-9965-4f30-8ba3-3ee97f36a684 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:34.749804 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-911386c7-9965-4f30-8ba3-3ee97f36a684 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.149157 Aug 01 07:40:34.750371 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 231/475] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:34 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:34.964833 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-61079d6f-4da0-4e08-825a-8ea2c463bfa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:34.965445 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-61079d6f-4da0-4e08-825a-8ea2c463bfa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:34.972051 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-61079d6f-4da0-4e08-825a-8ea2c463bfa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:34.972506 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-61079d6f-4da0-4e08-825a-8ea2c463bfa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:34.973531 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-61079d6f-4da0-4e08-825a-8ea2c463bfa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:34.973972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-61079d6f-4da0-4e08-825a-8ea2c463bfa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:35.102929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-61079d6f-4da0-4e08-825a-8ea2c463bfa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:35.112553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-61079d6f-4da0-4e08-825a-8ea2c463bfa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:35.114087 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-61079d6f-4da0-4e08-825a-8ea2c463bfa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:35.115263 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-61079d6f-4da0-4e08-825a-8ea2c463bfa6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.154338 Aug 01 07:40:35.115868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 245/476] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:34 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:35.625874 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fe27299f-cd72-4c60-b30d-29c401f33126 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:35.626526 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fe27299f-cd72-4c60-b30d-29c401f33126 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:35.633216 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe27299f-cd72-4c60-b30d-29c401f33126 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:35.633667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe27299f-cd72-4c60-b30d-29c401f33126 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:35.634427 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe27299f-cd72-4c60-b30d-29c401f33126 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:35.635043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe27299f-cd72-4c60-b30d-29c401f33126 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:35.772396 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7cff22e7-0f35-45db-a07d-1d9779d6f85b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:35.773291 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7cff22e7-0f35-45db-a07d-1d9779d6f85b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:35.783700 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7cff22e7-0f35-45db-a07d-1d9779d6f85b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:35.784585 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7cff22e7-0f35-45db-a07d-1d9779d6f85b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:35.785371 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7cff22e7-0f35-45db-a07d-1d9779d6f85b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:35.785816 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7cff22e7-0f35-45db-a07d-1d9779d6f85b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:35.920696 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7cff22e7-0f35-45db-a07d-1d9779d6f85b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:35.928682 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7cff22e7-0f35-45db-a07d-1d9779d6f85b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.160308 Aug 01 07:40:35.929356 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 246/477] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:35 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:36.139004 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d6e6b7f3-99aa-4598-a314-860be48b6f14 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:36.139632 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d6e6b7f3-99aa-4598-a314-860be48b6f14 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:36.146534 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d6e6b7f3-99aa-4598-a314-860be48b6f14 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:36.146981 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d6e6b7f3-99aa-4598-a314-860be48b6f14 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:36.147815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d6e6b7f3-99aa-4598-a314-860be48b6f14 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:36.148248 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d6e6b7f3-99aa-4598-a314-860be48b6f14 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:36.302367 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d6e6b7f3-99aa-4598-a314-860be48b6f14 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:36.312837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fe27299f-cd72-4c60-b30d-29c401f33126 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:36.326802 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fe27299f-cd72-4c60-b30d-29c401f33126 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.703535 Aug 01 07:40:36.327467 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 232/478] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:35 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:36.332407 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d6e6b7f3-99aa-4598-a314-860be48b6f14 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:36.334206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d6e6b7f3-99aa-4598-a314-860be48b6f14 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:36.335620 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d6e6b7f3-99aa-4598-a314-860be48b6f14 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.200517 Aug 01 07:40:36.337401 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 247/479] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:36 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:36.949884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-318de0d2-a248-49a9-9775-c3046e5e1a6c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:36.950520 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-318de0d2-a248-49a9-9775-c3046e5e1a6c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:36.956885 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-318de0d2-a248-49a9-9775-c3046e5e1a6c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:36.957341 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-318de0d2-a248-49a9-9775-c3046e5e1a6c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:36.958104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-318de0d2-a248-49a9-9775-c3046e5e1a6c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:36.958541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-318de0d2-a248-49a9-9775-c3046e5e1a6c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:37.088320 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-318de0d2-a248-49a9-9775-c3046e5e1a6c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:37.096306 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-318de0d2-a248-49a9-9775-c3046e5e1a6c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.150250 Aug 01 07:40:37.096872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 233/480] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:36 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:37.351937 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-05e3ae8a-54b8-41b6-aa86-13f555e58799 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:37.352548 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-05e3ae8a-54b8-41b6-aa86-13f555e58799 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:37.359238 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-05e3ae8a-54b8-41b6-aa86-13f555e58799 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:37.359557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-13d9c299-f693-4ab9-97ae-c55e531e1cd1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:37.359676 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-05e3ae8a-54b8-41b6-aa86-13f555e58799 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:37.360132 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-13d9c299-f693-4ab9-97ae-c55e531e1cd1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:37.360439 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-05e3ae8a-54b8-41b6-aa86-13f555e58799 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:37.361430 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-05e3ae8a-54b8-41b6-aa86-13f555e58799 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:37.367060 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13d9c299-f693-4ab9-97ae-c55e531e1cd1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:37.367532 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13d9c299-f693-4ab9-97ae-c55e531e1cd1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:37.368306 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13d9c299-f693-4ab9-97ae-c55e531e1cd1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:37.368725 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13d9c299-f693-4ab9-97ae-c55e531e1cd1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:37.439779 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:40:37.440103 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Mon Aug 1 07:40:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 (ip 10.222.0.40) !!! Aug 01 07:40:37.496228 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-05e3ae8a-54b8-41b6-aa86-13f555e58799 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:37.502363 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-13d9c299-f693-4ab9-97ae-c55e531e1cd1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:37.504186 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-05e3ae8a-54b8-41b6-aa86-13f555e58799 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.156151 Aug 01 07:40:37.504755 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 248/481] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:37 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:37.511137 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-13d9c299-f693-4ab9-97ae-c55e531e1cd1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:37.512653 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-13d9c299-f693-4ab9-97ae-c55e531e1cd1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:37.513850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-13d9c299-f693-4ab9-97ae-c55e531e1cd1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.158288 Aug 01 07:40:37.514393 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 234/482] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:37 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:38.116371 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4c69ac10-eeb6-4808-a0d0-b120e96ef3a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:38.117115 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4c69ac10-eeb6-4808-a0d0-b120e96ef3a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:38.123141 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c69ac10-eeb6-4808-a0d0-b120e96ef3a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:38.123590 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c69ac10-eeb6-4808-a0d0-b120e96ef3a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:38.124343 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c69ac10-eeb6-4808-a0d0-b120e96ef3a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:38.124773 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c69ac10-eeb6-4808-a0d0-b120e96ef3a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:38.259858 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4c69ac10-eeb6-4808-a0d0-b120e96ef3a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:38.267989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4c69ac10-eeb6-4808-a0d0-b120e96ef3a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.154637 Aug 01 07:40:38.268689 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 249/483] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:38 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:38.524947 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2350db11-7a52-402e-bb8d-8d45aa3da9e4 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:38.525571 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2350db11-7a52-402e-bb8d-8d45aa3da9e4 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:38.531704 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2350db11-7a52-402e-bb8d-8d45aa3da9e4 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:38.532303 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2350db11-7a52-402e-bb8d-8d45aa3da9e4 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:38.533114 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2350db11-7a52-402e-bb8d-8d45aa3da9e4 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:38.533549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2350db11-7a52-402e-bb8d-8d45aa3da9e4 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:38.537146 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ede4e2d7-e0eb-440f-ad9d-98373fb17dcc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:38.537744 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ede4e2d7-e0eb-440f-ad9d-98373fb17dcc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:38.544093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ede4e2d7-e0eb-440f-ad9d-98373fb17dcc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:38.544539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ede4e2d7-e0eb-440f-ad9d-98373fb17dcc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:38.545296 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ede4e2d7-e0eb-440f-ad9d-98373fb17dcc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:38.545727 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ede4e2d7-e0eb-440f-ad9d-98373fb17dcc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:38.549722 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=100 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:38.601970 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:38.629749 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=6 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:38.672028 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2350db11-7a52-402e-bb8d-8d45aa3da9e4 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:38.677984 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ede4e2d7-e0eb-440f-ad9d-98373fb17dcc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:38.681093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2350db11-7a52-402e-bb8d-8d45aa3da9e4 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.159767 Aug 01 07:40:38.682088 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 235/484] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:38 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:38.687213 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ede4e2d7-e0eb-440f-ad9d-98373fb17dcc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:38.688703 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ede4e2d7-e0eb-440f-ad9d-98373fb17dcc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:38.690126 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ede4e2d7-e0eb-440f-ad9d-98373fb17dcc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.156939 Aug 01 07:40:38.690676 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 250/485] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:38 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:39.288551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e7e8d75d-e100-4327-91ad-24df1234dc90 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:39.289162 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e7e8d75d-e100-4327-91ad-24df1234dc90 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:39.291027 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:39.296875 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e7e8d75d-e100-4327-91ad-24df1234dc90 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:39.297329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e7e8d75d-e100-4327-91ad-24df1234dc90 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:39.298092 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e7e8d75d-e100-4327-91ad-24df1234dc90 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:39.299003 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e7e8d75d-e100-4327-91ad-24df1234dc90 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:39.431773 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e7e8d75d-e100-4327-91ad-24df1234dc90 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:39.439938 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e7e8d75d-e100-4327-91ad-24df1234dc90 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.154604 Aug 01 07:40:39.440497 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 236/486] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:39 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:39.707732 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-704f385f-f67d-4cfa-a3fe-dbcb50121d55 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:39.708450 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-704f385f-f67d-4cfa-a3fe-dbcb50121d55 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:39.714675 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-829e441e-153b-4b95-9a50-a720611c3ce5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:39.715372 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-704f385f-f67d-4cfa-a3fe-dbcb50121d55 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:39.715564 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-829e441e-153b-4b95-9a50-a720611c3ce5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:39.715839 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-704f385f-f67d-4cfa-a3fe-dbcb50121d55 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:39.716665 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-704f385f-f67d-4cfa-a3fe-dbcb50121d55 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:39.717116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-704f385f-f67d-4cfa-a3fe-dbcb50121d55 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:39.722893 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-829e441e-153b-4b95-9a50-a720611c3ce5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:39.723485 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-829e441e-153b-4b95-9a50-a720611c3ce5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:39.724541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-829e441e-153b-4b95-9a50-a720611c3ce5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:39.724988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-829e441e-153b-4b95-9a50-a720611c3ce5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:39.862869 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-704f385f-f67d-4cfa-a3fe-dbcb50121d55 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:39.869582 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-829e441e-153b-4b95-9a50-a720611c3ce5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:39.870916 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-704f385f-f67d-4cfa-a3fe-dbcb50121d55 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1319 microversion: 2.1 time: 0.167047 Aug 01 07:40:39.871721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 251/487] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:39 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:39.884425 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-829e441e-153b-4b95-9a50-a720611c3ce5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:39.886092 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-829e441e-153b-4b95-9a50-a720611c3ce5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:39.887291 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-829e441e-153b-4b95-9a50-a720611c3ce5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.177511 Aug 01 07:40:39.887850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 237/488] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:39 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:40.460191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8c5283e1-a5fe-434b-b845-c4431dd99fa3 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:40.460808 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8c5283e1-a5fe-434b-b845-c4431dd99fa3 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:40.466801 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8c5283e1-a5fe-434b-b845-c4431dd99fa3 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:40.467314 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8c5283e1-a5fe-434b-b845-c4431dd99fa3 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:40.468089 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8c5283e1-a5fe-434b-b845-c4431dd99fa3 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:40.468532 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8c5283e1-a5fe-434b-b845-c4431dd99fa3 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:40.627768 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8c5283e1-a5fe-434b-b845-c4431dd99fa3 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:40.636750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8c5283e1-a5fe-434b-b845-c4431dd99fa3 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.180257 Aug 01 07:40:40.650176 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 252/489] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:40 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:40.893327 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-18f497f9-a198-487a-8665-dbefb3da3787 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:40.893874 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-18f497f9-a198-487a-8665-dbefb3da3787 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:40.899917 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-18f497f9-a198-487a-8665-dbefb3da3787 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:40.900367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-18f497f9-a198-487a-8665-dbefb3da3787 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:40.901122 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-18f497f9-a198-487a-8665-dbefb3da3787 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:40.901559 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-18f497f9-a198-487a-8665-dbefb3da3787 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:40.910940 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8da170bb-f74f-4159-8ae9-72964d2eebf1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:40.911570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8da170bb-f74f-4159-8ae9-72964d2eebf1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:40.917988 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8da170bb-f74f-4159-8ae9-72964d2eebf1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:40.918438 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8da170bb-f74f-4159-8ae9-72964d2eebf1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:40.919221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8da170bb-f74f-4159-8ae9-72964d2eebf1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:40.919656 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8da170bb-f74f-4159-8ae9-72964d2eebf1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:41.036459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-18f497f9-a198-487a-8665-dbefb3da3787 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:41.044095 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-18f497f9-a198-487a-8665-dbefb3da3787 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1508 microversion: 2.1 time: 0.155184 Aug 01 07:40:41.044680 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 238/490] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:40 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:41.051249 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8da170bb-f74f-4159-8ae9-72964d2eebf1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:41.059755 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8da170bb-f74f-4159-8ae9-72964d2eebf1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:41.061265 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8da170bb-f74f-4159-8ae9-72964d2eebf1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:41.062417 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8da170bb-f74f-4159-8ae9-72964d2eebf1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.156050 Aug 01 07:40:41.062962 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 253/491] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:40 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:40:41.657565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ad1f6f8b-7bb5-4abc-9fa1-b54aeb6b9c44 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:41.658831 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ad1f6f8b-7bb5-4abc-9fa1-b54aeb6b9c44 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:41.661028 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:41.666454 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad1f6f8b-7bb5-4abc-9fa1-b54aeb6b9c44 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:41.666905 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad1f6f8b-7bb5-4abc-9fa1-b54aeb6b9c44 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:41.667703 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad1f6f8b-7bb5-4abc-9fa1-b54aeb6b9c44 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:41.668139 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad1f6f8b-7bb5-4abc-9fa1-b54aeb6b9c44 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:41.799586 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ad1f6f8b-7bb5-4abc-9fa1-b54aeb6b9c44 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:41.807284 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ad1f6f8b-7bb5-4abc-9fa1-b54aeb6b9c44 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.153512 Aug 01 07:40:41.807849 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 239/492] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:41 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:42.086206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bf5dd227-9ce8-4306-a57e-e732e21fbf9e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:42.086810 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-bf5dd227-9ce8-4306-a57e-e732e21fbf9e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:42.093294 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bf5dd227-9ce8-4306-a57e-e732e21fbf9e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:42.093823 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bf5dd227-9ce8-4306-a57e-e732e21fbf9e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:42.094583 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bf5dd227-9ce8-4306-a57e-e732e21fbf9e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:42.095022 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bf5dd227-9ce8-4306-a57e-e732e21fbf9e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:42.229052 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bf5dd227-9ce8-4306-a57e-e732e21fbf9e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:42.238141 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bf5dd227-9ce8-4306-a57e-e732e21fbf9e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:42.239734 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bf5dd227-9ce8-4306-a57e-e732e21fbf9e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:42.240959 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-bf5dd227-9ce8-4306-a57e-e732e21fbf9e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.159597 Aug 01 07:40:42.241528 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 254/493] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:42 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:42.827813 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-de99c499-4303-4588-813f-4b5c108385a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:42.828991 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-de99c499-4303-4588-813f-4b5c108385a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:42.835432 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-de99c499-4303-4588-813f-4b5c108385a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:42.835963 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-de99c499-4303-4588-813f-4b5c108385a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:42.836807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-de99c499-4303-4588-813f-4b5c108385a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:42.837313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-de99c499-4303-4588-813f-4b5c108385a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:42.857221 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:42.985078 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-de99c499-4303-4588-813f-4b5c108385a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:42.993348 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-de99c499-4303-4588-813f-4b5c108385a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.169605 Aug 01 07:40:42.993934 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 240/494] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:42 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:43.020712 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-099d1675-8d8a-4c29-a885-72d926de22f7 req-c5ffe2ac-c288-4ddc-8214-aa52eb672533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff143cc-5a30-44be-a327-29eaacf61348", "name": "network-vif-plugged", "status": "completed", "tag": "7b59d41d-43d0-4098-917e-f7635e0051db"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:43.030005 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-099d1675-8d8a-4c29-a885-72d926de22f7 req-c5ffe2ac-c288-4ddc-8214-aa52eb672533 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:43.030529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-099d1675-8d8a-4c29-a885-72d926de22f7 req-c5ffe2ac-c288-4ddc-8214-aa52eb672533 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:43.043258 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-099d1675-8d8a-4c29-a885-72d926de22f7 req-c5ffe2ac-c288-4ddc-8214-aa52eb672533 service nova] Creating event network-vif-plugged:7b59d41d-43d0-4098-917e-f7635e0051db for instance 8ff143cc-5a30-44be-a327-29eaacf61348 on hv-cinder-73306 Aug 01 07:40:43.052616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-099d1675-8d8a-4c29-a885-72d926de22f7 req-c5ffe2ac-c288-4ddc-8214-aa52eb672533 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036818 Aug 01 07:40:43.053375 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 255/495] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:40:43.264806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4d5088ba-9e3e-4fba-be8c-ed771fd948c2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:43.265407 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4d5088ba-9e3e-4fba-be8c-ed771fd948c2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:43.271899 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4d5088ba-9e3e-4fba-be8c-ed771fd948c2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:43.272351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4d5088ba-9e3e-4fba-be8c-ed771fd948c2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:43.273104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4d5088ba-9e3e-4fba-be8c-ed771fd948c2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:43.273541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4d5088ba-9e3e-4fba-be8c-ed771fd948c2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:43.404885 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4d5088ba-9e3e-4fba-be8c-ed771fd948c2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:43.413837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4d5088ba-9e3e-4fba-be8c-ed771fd948c2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:43.415382 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4d5088ba-9e3e-4fba-be8c-ed771fd948c2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:43.416529 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4d5088ba-9e3e-4fba-be8c-ed771fd948c2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.155709 Aug 01 07:40:43.417074 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 241/496] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:43 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:44.016074 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2e03e2b3-6147-4bdc-b64f-18643c4efabd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:44.016773 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2e03e2b3-6147-4bdc-b64f-18643c4efabd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:44.023271 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e03e2b3-6147-4bdc-b64f-18643c4efabd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:44.023730 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e03e2b3-6147-4bdc-b64f-18643c4efabd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:44.024497 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e03e2b3-6147-4bdc-b64f-18643c4efabd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:44.024931 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e03e2b3-6147-4bdc-b64f-18643c4efabd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:44.162621 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2e03e2b3-6147-4bdc-b64f-18643c4efabd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:44.171102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2e03e2b3-6147-4bdc-b64f-18643c4efabd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.159964 Aug 01 07:40:44.171791 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 256/497] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:44 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:44.439232 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3aed7a81-1d39-48bd-b367-06c04f7697cf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:44.439838 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3aed7a81-1d39-48bd-b367-06c04f7697cf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:44.446477 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3aed7a81-1d39-48bd-b367-06c04f7697cf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:44.446922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3aed7a81-1d39-48bd-b367-06c04f7697cf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:44.447749 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3aed7a81-1d39-48bd-b367-06c04f7697cf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:44.448169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3aed7a81-1d39-48bd-b367-06c04f7697cf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:44.592534 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3aed7a81-1d39-48bd-b367-06c04f7697cf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:44.601729 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3aed7a81-1d39-48bd-b367-06c04f7697cf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:44.603287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3aed7a81-1d39-48bd-b367-06c04f7697cf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:44.604446 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3aed7a81-1d39-48bd-b367-06c04f7697cf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.169127 Aug 01 07:40:44.621426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 242/498] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:44 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:45.193028 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5e5bcc49-a413-4e86-9c16-356352f106a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:45.193655 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5e5bcc49-a413-4e86-9c16-356352f106a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:45.200204 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5e5bcc49-a413-4e86-9c16-356352f106a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:45.200653 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5e5bcc49-a413-4e86-9c16-356352f106a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:45.201412 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5e5bcc49-a413-4e86-9c16-356352f106a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:45.201844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5e5bcc49-a413-4e86-9c16-356352f106a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:45.346612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5e5bcc49-a413-4e86-9c16-356352f106a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:45.354868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5e5bcc49-a413-4e86-9c16-356352f106a2 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.166167 Aug 01 07:40:45.357595 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 257/499] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:45 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:45.632347 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-05a16221-50c4-443e-a377-4bd056cb832a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:45.633229 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-05a16221-50c4-443e-a377-4bd056cb832a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:45.640124 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05a16221-50c4-443e-a377-4bd056cb832a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:45.640565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05a16221-50c4-443e-a377-4bd056cb832a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:45.641548 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05a16221-50c4-443e-a377-4bd056cb832a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:45.641977 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-05a16221-50c4-443e-a377-4bd056cb832a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:45.782115 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-05a16221-50c4-443e-a377-4bd056cb832a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:45.790737 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-05a16221-50c4-443e-a377-4bd056cb832a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:45.792329 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-05a16221-50c4-443e-a377-4bd056cb832a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:45.793496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-05a16221-50c4-443e-a377-4bd056cb832a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.165628 Aug 01 07:40:45.794151 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 243/500] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:45 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:46.376527 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-47f42d88-238f-477a-a2d4-1d42c82f1d7c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:46.377168 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-47f42d88-238f-477a-a2d4-1d42c82f1d7c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:46.384721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-47f42d88-238f-477a-a2d4-1d42c82f1d7c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:46.385170 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-47f42d88-238f-477a-a2d4-1d42c82f1d7c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:46.385957 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-47f42d88-238f-477a-a2d4-1d42c82f1d7c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:46.386387 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-47f42d88-238f-477a-a2d4-1d42c82f1d7c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:46.535901 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-47f42d88-238f-477a-a2d4-1d42c82f1d7c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:46.543486 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-47f42d88-238f-477a-a2d4-1d42c82f1d7c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.170717 Aug 01 07:40:46.544051 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 258/501] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:46 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:46.817007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-306392f4-a2fd-46ef-bff6-98c765a7bad9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:46.817750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-306392f4-a2fd-46ef-bff6-98c765a7bad9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:46.823878 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-306392f4-a2fd-46ef-bff6-98c765a7bad9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:46.824351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-306392f4-a2fd-46ef-bff6-98c765a7bad9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:46.825109 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-306392f4-a2fd-46ef-bff6-98c765a7bad9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:46.825550 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-306392f4-a2fd-46ef-bff6-98c765a7bad9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:46.959432 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-306392f4-a2fd-46ef-bff6-98c765a7bad9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:46.968316 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-306392f4-a2fd-46ef-bff6-98c765a7bad9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:46.969940 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-306392f4-a2fd-46ef-bff6-98c765a7bad9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:46.971134 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-306392f4-a2fd-46ef-bff6-98c765a7bad9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1808 microversion: 2.20 time: 0.158722 Aug 01 07:40:46.971768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 244/502] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:46 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:47.564314 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bd9df0ab-9915-4f7e-88ae-9094ad8059c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:47.564938 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-bd9df0ab-9915-4f7e-88ae-9094ad8059c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:47.572228 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bd9df0ab-9915-4f7e-88ae-9094ad8059c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:47.572672 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bd9df0ab-9915-4f7e-88ae-9094ad8059c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:47.573426 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bd9df0ab-9915-4f7e-88ae-9094ad8059c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:47.573857 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bd9df0ab-9915-4f7e-88ae-9094ad8059c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:47.707577 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bd9df0ab-9915-4f7e-88ae-9094ad8059c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:47.715040 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-bd9df0ab-9915-4f7e-88ae-9094ad8059c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.154521 Aug 01 07:40:47.715620 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 259/503] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:47 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:47.993898 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fb642af5-8ccf-41e1-a500-b6902f96a241 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:47.994494 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fb642af5-8ccf-41e1-a500-b6902f96a241 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:48.000505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb642af5-8ccf-41e1-a500-b6902f96a241 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:48.000951 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb642af5-8ccf-41e1-a500-b6902f96a241 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:48.001732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb642af5-8ccf-41e1-a500-b6902f96a241 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:48.002250 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb642af5-8ccf-41e1-a500-b6902f96a241 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:48.145247 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fb642af5-8ccf-41e1-a500-b6902f96a241 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:48.153732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fb642af5-8ccf-41e1-a500-b6902f96a241 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:48.155306 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fb642af5-8ccf-41e1-a500-b6902f96a241 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:48.156484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fb642af5-8ccf-41e1-a500-b6902f96a241 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1795 microversion: 2.20 time: 0.166518 Aug 01 07:40:48.157014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 245/504] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:40:47 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1795 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:40:48.737668 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-92acee8e-5f1c-4508-89ed-b9376c3624f1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:48.738410 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-92acee8e-5f1c-4508-89ed-b9376c3624f1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:48.741534 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:40:48.747574 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-92acee8e-5f1c-4508-89ed-b9376c3624f1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:48.748015 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-92acee8e-5f1c-4508-89ed-b9376c3624f1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:48.748769 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-92acee8e-5f1c-4508-89ed-b9376c3624f1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:48.749201 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-92acee8e-5f1c-4508-89ed-b9376c3624f1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:48.896385 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-92acee8e-5f1c-4508-89ed-b9376c3624f1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:48.903951 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-92acee8e-5f1c-4508-89ed-b9376c3624f1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.171239 Aug 01 07:40:48.904516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 260/505] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:48 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:49.925217 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3e94b8eb-2e30-4bf1-b57a-6d46ac343289 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:49.925842 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3e94b8eb-2e30-4bf1-b57a-6d46ac343289 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:49.931962 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3e94b8eb-2e30-4bf1-b57a-6d46ac343289 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:49.932407 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3e94b8eb-2e30-4bf1-b57a-6d46ac343289 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:49.933190 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3e94b8eb-2e30-4bf1-b57a-6d46ac343289 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:49.933623 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3e94b8eb-2e30-4bf1-b57a-6d46ac343289 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:50.066255 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3e94b8eb-2e30-4bf1-b57a-6d46ac343289 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:50.073830 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3e94b8eb-2e30-4bf1-b57a-6d46ac343289 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.152610 Aug 01 07:40:50.074478 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 246/506] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:49 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:51.095980 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-51cb534f-c515-4d48-b5ae-0c1d63f11aa0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:51.096804 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-51cb534f-c515-4d48-b5ae-0c1d63f11aa0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:51.109498 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-51cb534f-c515-4d48-b5ae-0c1d63f11aa0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:51.110165 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-51cb534f-c515-4d48-b5ae-0c1d63f11aa0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:51.111044 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-51cb534f-c515-4d48-b5ae-0c1d63f11aa0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:51.111509 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-51cb534f-c515-4d48-b5ae-0c1d63f11aa0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:51.252094 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-51cb534f-c515-4d48-b5ae-0c1d63f11aa0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:51.261057 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-51cb534f-c515-4d48-b5ae-0c1d63f11aa0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.168962 Aug 01 07:40:51.261705 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 261/507] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:51 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:40:52.282500 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-074de8f8-0931-456e-bdb1-ab74af0ab559 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:52.284441 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-074de8f8-0931-456e-bdb1-ab74af0ab559 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:52.290324 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-074de8f8-0931-456e-bdb1-ab74af0ab559 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:52.290772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-074de8f8-0931-456e-bdb1-ab74af0ab559 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:52.291573 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-074de8f8-0931-456e-bdb1-ab74af0ab559 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:52.292182 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-074de8f8-0931-456e-bdb1-ab74af0ab559 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:52.563563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-074de8f8-0931-456e-bdb1-ab74af0ab559 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:52.573064 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-074de8f8-0931-456e-bdb1-ab74af0ab559 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.294914 Aug 01 07:40:52.573721 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 247/508] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:52 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:53.594092 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-66ce2c33-3b0c-4e5c-b0e5-4ce0e7658b9f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:53.594696 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-66ce2c33-3b0c-4e5c-b0e5-4ce0e7658b9f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:53.603286 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-66ce2c33-3b0c-4e5c-b0e5-4ce0e7658b9f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:53.603818 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-66ce2c33-3b0c-4e5c-b0e5-4ce0e7658b9f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:53.605221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-66ce2c33-3b0c-4e5c-b0e5-4ce0e7658b9f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:53.606576 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-66ce2c33-3b0c-4e5c-b0e5-4ce0e7658b9f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:53.810777 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-66ce2c33-3b0c-4e5c-b0e5-4ce0e7658b9f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:53.819854 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-66ce2c33-3b0c-4e5c-b0e5-4ce0e7658b9f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.229033 Aug 01 07:40:53.834667 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 262/509] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:53 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:54.849741 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f063e362-0798-4066-b9a2-61092c42a44c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:54.850420 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f063e362-0798-4066-b9a2-61092c42a44c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:54.851688 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-0c2fc3a2-3209-45c7-9acd-05b94775d4d5 req-8c5a4c89-9208-4de6-ab11-304ddaf6a546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb", "name": "network-vif-plugged", "status": "completed", "tag": "ff25bf32-73a3-4dbc-8956-4b8f21c3165b"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:54.865273 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f063e362-0798-4066-b9a2-61092c42a44c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:54.866015 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f063e362-0798-4066-b9a2-61092c42a44c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:54.866972 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f063e362-0798-4066-b9a2-61092c42a44c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:54.867592 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f063e362-0798-4066-b9a2-61092c42a44c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:54.872800 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-0c2fc3a2-3209-45c7-9acd-05b94775d4d5 req-8c5a4c89-9208-4de6-ab11-304ddaf6a546 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:54.873253 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-0c2fc3a2-3209-45c7-9acd-05b94775d4d5 req-8c5a4c89-9208-4de6-ab11-304ddaf6a546 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:54.899890 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-0c2fc3a2-3209-45c7-9acd-05b94775d4d5 req-8c5a4c89-9208-4de6-ab11-304ddaf6a546 service nova] Creating event network-vif-plugged:ff25bf32-73a3-4dbc-8956-4b8f21c3165b for instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb on hv-cinder-73306 Aug 01 07:40:54.908971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-0c2fc3a2-3209-45c7-9acd-05b94775d4d5 req-8c5a4c89-9208-4de6-ab11-304ddaf6a546 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060770 Aug 01 07:40:54.910167 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 263/510] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:40:55.107325 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f063e362-0798-4066-b9a2-61092c42a44c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:55.120413 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f063e362-0798-4066-b9a2-61092c42a44c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.282264 Aug 01 07:40:55.121172 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 248/511] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:54 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:56.144073 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9fd25401-f19e-40ee-8f7c-27634067d99b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:56.149971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9fd25401-f19e-40ee-8f7c-27634067d99b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:56.157025 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9fd25401-f19e-40ee-8f7c-27634067d99b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:56.157727 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9fd25401-f19e-40ee-8f7c-27634067d99b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:56.158880 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9fd25401-f19e-40ee-8f7c-27634067d99b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:56.159511 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9fd25401-f19e-40ee-8f7c-27634067d99b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:56.327010 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9fd25401-f19e-40ee-8f7c-27634067d99b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:56.335170 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9fd25401-f19e-40ee-8f7c-27634067d99b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1266 microversion: 2.1 time: 0.196884 Aug 01 07:40:56.335715 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 264/512] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:56 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:57.170718 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-57054605-77fd-4355-8a81-6dfb5483ff57 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:57.171374 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-57054605-77fd-4355-8a81-6dfb5483ff57 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:57.177825 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-57054605-77fd-4355-8a81-6dfb5483ff57 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:57.178514 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-57054605-77fd-4355-8a81-6dfb5483ff57 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:57.179685 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-57054605-77fd-4355-8a81-6dfb5483ff57 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:57.180420 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-57054605-77fd-4355-8a81-6dfb5483ff57 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:57.341762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-57054605-77fd-4355-8a81-6dfb5483ff57 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lazy-loading 'services' on Instance uuid 48863078-f7de-4370-af9c-4bdba932b5c3 {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:40:57.365552 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-aca6ab23-a093-4b27-b94c-651522023b25 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:57.366265 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-aca6ab23-a093-4b27-b94c-651522023b25 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:57.378261 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aca6ab23-a093-4b27-b94c-651522023b25 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:57.379058 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aca6ab23-a093-4b27-b94c-651522023b25 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:57.384364 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aca6ab23-a093-4b27-b94c-651522023b25 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:57.384988 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aca6ab23-a093-4b27-b94c-651522023b25 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:57.547464 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-57054605-77fd-4355-8a81-6dfb5483ff57 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "DELETE /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/os-volume_attachments/67cfdef9-591b-47bc-b195-63c893a76959" status: 202 len: 0 microversion: 2.1 time: 0.380657 Aug 01 07:40:57.548211 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 249/513] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:40:57 2022] DELETE /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/os-volume_attachments/67cfdef9-591b-47bc-b195-63c893a76959 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:40:57.759516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-aca6ab23-a093-4b27-b94c-651522023b25 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:57.771943 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-aca6ab23-a093-4b27-b94c-651522023b25 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1453 microversion: 2.1 time: 0.415024 Aug 01 07:40:57.784385 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 265/514] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:57 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1453 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:57.794816 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8479c941-703d-418b-8e5f-c4c2e6306dae tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:40:57.795882 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8479c941-703d-418b-8e5f-c4c2e6306dae tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:40:57.803113 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8479c941-703d-418b-8e5f-c4c2e6306dae tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:57.803884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8479c941-703d-418b-8e5f-c4c2e6306dae tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:57.804771 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8479c941-703d-418b-8e5f-c4c2e6306dae tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:57.805273 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8479c941-703d-418b-8e5f-c4c2e6306dae tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:58.014389 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8479c941-703d-418b-8e5f-c4c2e6306dae tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:40:58.026048 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8479c941-703d-418b-8e5f-c4c2e6306dae tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1453 microversion: 2.1 time: 0.234442 Aug 01 07:40:58.027144 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 250/515] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:40:57 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1453 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:40:59.829486 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7f9bc448-8a7c-46d8-8ae2-c59384dd08a5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:40:59.853332 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f9bc448-8a7c-46d8-8ae2-c59384dd08a5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:40:59.855766 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f9bc448-8a7c-46d8-8ae2-c59384dd08a5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:40:59.902454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7f9bc448-8a7c-46d8-8ae2-c59384dd08a5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Going to try to stop instance {{(pid=124279) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 07:41:00.016807 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7f9bc448-8a7c-46d8-8ae2-c59384dd08a5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/action" status: 202 len: 0 microversion: 2.1 time: 0.191607 Aug 01 07:41:00.018828 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 266/516] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:40:59 2022] POST /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:41:00.026768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5ea6f18c-4f52-453c-ba9b-b88461b9efff tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:00.027545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5ea6f18c-4f52-453c-ba9b-b88461b9efff tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:00.036102 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ea6f18c-4f52-453c-ba9b-b88461b9efff tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:00.037202 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ea6f18c-4f52-453c-ba9b-b88461b9efff tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:00.038599 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ea6f18c-4f52-453c-ba9b-b88461b9efff tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:00.039615 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ea6f18c-4f52-453c-ba9b-b88461b9efff tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:00.414666 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5ea6f18c-4f52-453c-ba9b-b88461b9efff tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:00.427872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5ea6f18c-4f52-453c-ba9b-b88461b9efff tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.404895 Aug 01 07:41:00.434342 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 251/517] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:00 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:00.879205 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-a9d7712e-7f09-4c9c-955b-0c25cc11cb3c req-0477a5c1-aca8-4c32-b280-1ac1c4120890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb", "tag": "ff25bf32-73a3-4dbc-8956-4b8f21c3165b"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:00.909560 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-a9d7712e-7f09-4c9c-955b-0c25cc11cb3c req-0477a5c1-aca8-4c32-b280-1ac1c4120890 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:00.911684 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-a9d7712e-7f09-4c9c-955b-0c25cc11cb3c req-0477a5c1-aca8-4c32-b280-1ac1c4120890 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:00.948073 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:00.951413 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-a9d7712e-7f09-4c9c-955b-0c25cc11cb3c req-0477a5c1-aca8-4c32-b280-1ac1c4120890 service nova] Creating event network-changed:ff25bf32-73a3-4dbc-8956-4b8f21c3165b for instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb on hv-cinder-73306 Aug 01 07:41:00.962484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-a9d7712e-7f09-4c9c-955b-0c25cc11cb3c req-0477a5c1-aca8-4c32-b280-1ac1c4120890 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087711 Aug 01 07:41:00.964455 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 267/518] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:41:01.462186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9dac214e-1ad5-4a94-a9a2-5da307bd2c95 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:01.462809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9dac214e-1ad5-4a94-a9a2-5da307bd2c95 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:01.473667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9dac214e-1ad5-4a94-a9a2-5da307bd2c95 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:01.473667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9dac214e-1ad5-4a94-a9a2-5da307bd2c95 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:01.474307 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9dac214e-1ad5-4a94-a9a2-5da307bd2c95 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:01.474696 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9dac214e-1ad5-4a94-a9a2-5da307bd2c95 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:01.866545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9dac214e-1ad5-4a94-a9a2-5da307bd2c95 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:01.887820 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9dac214e-1ad5-4a94-a9a2-5da307bd2c95 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.429329 Aug 01 07:41:01.889143 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 252/519] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:01 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:02.912402 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3ceea8e9-f3b1-4a12-a957-f5d886a75af0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:02.913593 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3ceea8e9-f3b1-4a12-a957-f5d886a75af0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:02.923986 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3ceea8e9-f3b1-4a12-a957-f5d886a75af0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:02.924784 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3ceea8e9-f3b1-4a12-a957-f5d886a75af0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:02.926177 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3ceea8e9-f3b1-4a12-a957-f5d886a75af0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:02.926865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3ceea8e9-f3b1-4a12-a957-f5d886a75af0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:03.118877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3ceea8e9-f3b1-4a12-a957-f5d886a75af0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:03.132067 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3ceea8e9-f3b1-4a12-a957-f5d886a75af0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.225795 Aug 01 07:41:03.133287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 268/520] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:02 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:04.087313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-843e5d78-58c5-4395-bd0a-e29f8e1a5661 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c823bf18-e9a3-44fd-bf38-a981bda3ec93", "device": "/dev/sdb"}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:04.092229 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-843e5d78-58c5-4395-bd0a-e29f8e1a5661 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:04.111005 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-843e5d78-58c5-4395-bd0a-e29f8e1a5661 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:04.118691 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-843e5d78-58c5-4395-bd0a-e29f8e1a5661 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:04.119836 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-843e5d78-58c5-4395-bd0a-e29f8e1a5661 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:04.120459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-843e5d78-58c5-4395-bd0a-e29f8e1a5661 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:04.155885 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ea5ff7c2-17eb-42dc-8e94-6647d025cc62 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:04.156794 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ea5ff7c2-17eb-42dc-8e94-6647d025cc62 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:04.177544 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ea5ff7c2-17eb-42dc-8e94-6647d025cc62 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:04.178159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ea5ff7c2-17eb-42dc-8e94-6647d025cc62 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:04.179277 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ea5ff7c2-17eb-42dc-8e94-6647d025cc62 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:04.181171 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ea5ff7c2-17eb-42dc-8e94-6647d025cc62 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:04.404125 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ea5ff7c2-17eb-42dc-8e94-6647d025cc62 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:04.414314 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ea5ff7c2-17eb-42dc-8e94-6647d025cc62 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.262874 Aug 01 07:41:04.419657 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 269/521] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:04 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:04.599369 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-843e5d78-58c5-4395-bd0a-e29f8e1a5661 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "POST /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515859 Aug 01 07:41:04.601781 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 253/522] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:41:04 2022] POST /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:05.444229 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9a2c4a99-1a81-4353-b143-1a5307210ae5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:05.445417 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9a2c4a99-1a81-4353-b143-1a5307210ae5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:05.452529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9a2c4a99-1a81-4353-b143-1a5307210ae5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:05.452990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9a2c4a99-1a81-4353-b143-1a5307210ae5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:05.453780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9a2c4a99-1a81-4353-b143-1a5307210ae5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:05.454219 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9a2c4a99-1a81-4353-b143-1a5307210ae5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:05.617085 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9a2c4a99-1a81-4353-b143-1a5307210ae5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:05.626193 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9a2c4a99-1a81-4353-b143-1a5307210ae5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.186378 Aug 01 07:41:05.627864 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 270/523] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:05 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:06.655037 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-98bb449a-183d-4f94-8a93-8abce62e5b34 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:06.655897 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-98bb449a-183d-4f94-8a93-8abce62e5b34 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:06.668828 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-98bb449a-183d-4f94-8a93-8abce62e5b34 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:06.669376 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-98bb449a-183d-4f94-8a93-8abce62e5b34 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:06.670238 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-98bb449a-183d-4f94-8a93-8abce62e5b34 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:06.670740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-98bb449a-183d-4f94-8a93-8abce62e5b34 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:06.836906 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-98bb449a-183d-4f94-8a93-8abce62e5b34 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:06.852699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-98bb449a-183d-4f94-8a93-8abce62e5b34 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.197278 Aug 01 07:41:06.853662 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 254/524] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:06 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:07.870513 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a1e2476f-e493-4fe3-851f-d45e91c96ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:07.871362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a1e2476f-e493-4fe3-851f-d45e91c96ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:07.884280 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1e2476f-e493-4fe3-851f-d45e91c96ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:07.898295 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1e2476f-e493-4fe3-851f-d45e91c96ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:07.899178 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1e2476f-e493-4fe3-851f-d45e91c96ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:07.899988 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1e2476f-e493-4fe3-851f-d45e91c96ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:08.094148 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a1e2476f-e493-4fe3-851f-d45e91c96ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:08.103227 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a1e2476f-e493-4fe3-851f-d45e91c96ffe tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.237338 Aug 01 07:41:08.103728 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 271/525] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:07 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:09.129709 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cab7a85b-3325-4300-98a5-8eba7b3ad7f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:09.131016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-cab7a85b-3325-4300-98a5-8eba7b3ad7f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:09.137628 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cab7a85b-3325-4300-98a5-8eba7b3ad7f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:09.138256 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cab7a85b-3325-4300-98a5-8eba7b3ad7f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:09.139206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cab7a85b-3325-4300-98a5-8eba7b3ad7f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:09.139823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cab7a85b-3325-4300-98a5-8eba7b3ad7f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:09.159931 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:09.285967 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-cab7a85b-3325-4300-98a5-8eba7b3ad7f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:09.293531 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-cab7a85b-3325-4300-98a5-8eba7b3ad7f1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.168149 Aug 01 07:41:09.296835 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 255/526] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:09 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:10.315486 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2c1a6a1f-60de-45a4-8600-9244f04cdb64 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:10.316277 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2c1a6a1f-60de-45a4-8600-9244f04cdb64 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:10.323339 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2c1a6a1f-60de-45a4-8600-9244f04cdb64 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:10.324100 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2c1a6a1f-60de-45a4-8600-9244f04cdb64 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:10.324981 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2c1a6a1f-60de-45a4-8600-9244f04cdb64 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:10.325522 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2c1a6a1f-60de-45a4-8600-9244f04cdb64 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:10.477781 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2c1a6a1f-60de-45a4-8600-9244f04cdb64 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:10.487291 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2c1a6a1f-60de-45a4-8600-9244f04cdb64 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.176249 Aug 01 07:41:10.501586 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 272/527] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:10 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:11.509522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7b74e964-8cd6-4f50-ac04-2cd57da29ef4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:11.510240 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7b74e964-8cd6-4f50-ac04-2cd57da29ef4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:11.519941 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7b74e964-8cd6-4f50-ac04-2cd57da29ef4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:11.520388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7b74e964-8cd6-4f50-ac04-2cd57da29ef4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:11.521536 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7b74e964-8cd6-4f50-ac04-2cd57da29ef4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:11.521973 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7b74e964-8cd6-4f50-ac04-2cd57da29ef4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:11.667982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7b74e964-8cd6-4f50-ac04-2cd57da29ef4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:11.678486 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7b74e964-8cd6-4f50-ac04-2cd57da29ef4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.172924 Aug 01 07:41:11.679333 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 256/528] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:11 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:11.856805 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-56d3d5e8-5c66-43bb-bc1a-0dd28fb43e44 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Action: 'create', calling method: .version_select at 0x7fd0189db700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1364658719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ2DDGeQAYlEPYFHw7pFlJYkGQkZUrRmwqqHnpihOG+ycPTLq6rcCdxl7KNtA6T2l/+eqx4X5nigw4Xny7pfTOv7/IGUkIA7gCpSRYWVLpZhAFPQS/CBFvpcKiPf2eTzw=="}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:11.871932 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-56d3d5e8-5c66-43bb-bc1a-0dd28fb43e44 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Getting quotas for project a27abd6ed13c4174a4c14226fb48e146. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:41:11.875653 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-56d3d5e8-5c66-43bb-bc1a-0dd28fb43e44 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Getting quotas for user 6e461e65817648b0a878d8280c84dc6e and project a27abd6ed13c4174a4c14226fb48e146. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:41:11.897742 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-56d3d5e8-5c66-43bb-bc1a-0dd28fb43e44 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.044840 Aug 01 07:41:11.898483 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 273/529] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 1 07:41:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:11.947791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1594312169", "imageRef": "b8ca4b1a-0bf8-48f4-a657-4246a370c652", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1364658719", "networks": [{"uuid": "7bb45493-23c1-4b05-9e29-5bfa31a83643"}]}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:11.956318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=36 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:12.000041 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] validate_networks() for [('7bb45493-23c1-4b05-9e29-5bfa31a83643', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:41:12.375631 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:41:12.376389 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:41:12.377522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:41:12.378293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:41:12.378724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:41:12.388061 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:12.388640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:12.389373 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:12.389823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:12.407058 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Getting quotas for project a27abd6ed13c4174a4c14226fb48e146. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:41:12.411186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Getting quotas for user 6e461e65817648b0a878d8280c84dc6e and project a27abd6ed13c4174a4c14226fb48e146. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:41:12.422931 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:41:12.425913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ca4b1a-0bf8-48f4-a657-4246a370c652',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:41:12.487647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8efbf8b9-c27c-4bf1-b22f-28a6fa48c962 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543553 Aug 01 07:41:12.488369 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 257/530] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:41:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 07:41:12.500445 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6ff9607d-62bb-4266-8071-f6455babb2a9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:12.501028 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6ff9607d-62bb-4266-8071-f6455babb2a9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:12.562580 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6ff9607d-62bb-4266-8071-f6455babb2a9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:12.570841 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6ff9607d-62bb-4266-8071-f6455babb2a9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1259 microversion: 2.1 time: 0.074324 Aug 01 07:41:12.571448 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 274/531] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:12 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:12.700184 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8343a33c-76f2-400e-b094-4f01c73a1028 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:12.700796 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8343a33c-76f2-400e-b094-4f01c73a1028 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:12.708237 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8343a33c-76f2-400e-b094-4f01c73a1028 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:12.708694 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8343a33c-76f2-400e-b094-4f01c73a1028 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:12.709560 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8343a33c-76f2-400e-b094-4f01c73a1028 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:12.710004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8343a33c-76f2-400e-b094-4f01c73a1028 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:12.847333 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8343a33c-76f2-400e-b094-4f01c73a1028 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:12.855170 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8343a33c-76f2-400e-b094-4f01c73a1028 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.159277 Aug 01 07:41:12.855949 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 258/532] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:12 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:13.591347 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bc470206-932f-4987-a44f-ddcbba4ac331 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:13.591973 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-bc470206-932f-4987-a44f-ddcbba4ac331 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:13.599323 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bc470206-932f-4987-a44f-ddcbba4ac331 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:13.599711 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bc470206-932f-4987-a44f-ddcbba4ac331 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:13.600495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bc470206-932f-4987-a44f-ddcbba4ac331 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:13.601310 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bc470206-932f-4987-a44f-ddcbba4ac331 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:13.663456 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bc470206-932f-4987-a44f-ddcbba4ac331 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:13.670680 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-bc470206-932f-4987-a44f-ddcbba4ac331 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1263 microversion: 2.1 time: 0.083218 Aug 01 07:41:13.671261 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 275/533] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:13 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:13.876662 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-43b068df-37a2-4f36-8645-a327b4649eb2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:13.877513 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-43b068df-37a2-4f36-8645-a327b4649eb2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:13.884321 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-43b068df-37a2-4f36-8645-a327b4649eb2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:13.884778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-43b068df-37a2-4f36-8645-a327b4649eb2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:13.885546 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-43b068df-37a2-4f36-8645-a327b4649eb2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:13.885987 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-43b068df-37a2-4f36-8645-a327b4649eb2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:14.019591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-43b068df-37a2-4f36-8645-a327b4649eb2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:14.026984 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-43b068df-37a2-4f36-8645-a327b4649eb2 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.154372 Aug 01 07:41:14.027585 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 259/534] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:13 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:14.692837 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-cab925a8-e084-40d2-8071-9da04b9c35bc tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:14.693446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-cab925a8-e084-40d2-8071-9da04b9c35bc tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:14.699937 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cab925a8-e084-40d2-8071-9da04b9c35bc tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:14.700390 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cab925a8-e084-40d2-8071-9da04b9c35bc tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:14.701150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cab925a8-e084-40d2-8071-9da04b9c35bc tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:14.701584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cab925a8-e084-40d2-8071-9da04b9c35bc tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:14.762600 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-cab925a8-e084-40d2-8071-9da04b9c35bc tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:14.770291 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-cab925a8-e084-40d2-8071-9da04b9c35bc tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1263 microversion: 2.1 time: 0.082131 Aug 01 07:41:14.770861 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 276/535] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:14 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:15.050153 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4c1bf774-e085-451f-a867-6d5aa3215bd0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:15.050757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4c1bf774-e085-451f-a867-6d5aa3215bd0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:15.057248 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4c1bf774-e085-451f-a867-6d5aa3215bd0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:15.057698 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4c1bf774-e085-451f-a867-6d5aa3215bd0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:15.058447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4c1bf774-e085-451f-a867-6d5aa3215bd0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:15.058884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4c1bf774-e085-451f-a867-6d5aa3215bd0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:15.188484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4c1bf774-e085-451f-a867-6d5aa3215bd0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:15.196091 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4c1bf774-e085-451f-a867-6d5aa3215bd0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.150826 Aug 01 07:41:15.196652 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 260/536] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:15 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:15.791139 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-57aa1773-fc1a-4cb4-b3bb-92cb38a3723a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:15.791688 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-57aa1773-fc1a-4cb4-b3bb-92cb38a3723a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:15.798067 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57aa1773-fc1a-4cb4-b3bb-92cb38a3723a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:15.798619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57aa1773-fc1a-4cb4-b3bb-92cb38a3723a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:15.799428 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57aa1773-fc1a-4cb4-b3bb-92cb38a3723a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:15.799879 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-57aa1773-fc1a-4cb4-b3bb-92cb38a3723a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:15.861214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-57aa1773-fc1a-4cb4-b3bb-92cb38a3723a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:15.868461 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-57aa1773-fc1a-4cb4-b3bb-92cb38a3723a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1311 microversion: 2.1 time: 0.081527 Aug 01 07:41:15.869017 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 277/537] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:15 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1311 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:16.217143 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-47305818-d0f4-4202-a93c-55cda3afaf5f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:16.217758 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-47305818-d0f4-4202-a93c-55cda3afaf5f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:16.224429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-47305818-d0f4-4202-a93c-55cda3afaf5f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:16.225541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-47305818-d0f4-4202-a93c-55cda3afaf5f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:16.225680 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-47305818-d0f4-4202-a93c-55cda3afaf5f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:16.226076 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-47305818-d0f4-4202-a93c-55cda3afaf5f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:16.528747 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-47305818-d0f4-4202-a93c-55cda3afaf5f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:16.540383 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-47305818-d0f4-4202-a93c-55cda3afaf5f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.326991 Aug 01 07:41:16.541221 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 261/538] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:16 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:16.891704 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f77c6616-f3c7-4a95-a729-eee902dffc5f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:16.893143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f77c6616-f3c7-4a95-a729-eee902dffc5f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:16.903899 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f77c6616-f3c7-4a95-a729-eee902dffc5f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:16.904694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f77c6616-f3c7-4a95-a729-eee902dffc5f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:16.905844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f77c6616-f3c7-4a95-a729-eee902dffc5f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:16.906592 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f77c6616-f3c7-4a95-a729-eee902dffc5f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:17.001434 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f77c6616-f3c7-4a95-a729-eee902dffc5f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:17.015193 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f77c6616-f3c7-4a95-a729-eee902dffc5f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1317 microversion: 2.1 time: 0.128096 Aug 01 07:41:17.016024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 278/539] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:16 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1317 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:17.562810 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-884deb40-bc8e-469c-8224-b46f4ef4bece tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:17.563559 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-884deb40-bc8e-469c-8224-b46f4ef4bece tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:17.570686 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-884deb40-bc8e-469c-8224-b46f4ef4bece tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:17.571170 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-884deb40-bc8e-469c-8224-b46f4ef4bece tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:17.571943 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-884deb40-bc8e-469c-8224-b46f4ef4bece tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:17.572377 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-884deb40-bc8e-469c-8224-b46f4ef4bece tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:17.722844 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-884deb40-bc8e-469c-8224-b46f4ef4bece tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:17.731034 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-884deb40-bc8e-469c-8224-b46f4ef4bece tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.172681 Aug 01 07:41:17.732231 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 262/540] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:17 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:18.037807 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e548490a-af70-4234-9893-2af705e77b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:18.038421 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e548490a-af70-4234-9893-2af705e77b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:18.044901 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e548490a-af70-4234-9893-2af705e77b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:18.045359 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e548490a-af70-4234-9893-2af705e77b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:18.046124 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e548490a-af70-4234-9893-2af705e77b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:18.046561 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e548490a-af70-4234-9893-2af705e77b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:18.181496 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e548490a-af70-4234-9893-2af705e77b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:18.190272 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e548490a-af70-4234-9893-2af705e77b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.155280 Aug 01 07:41:18.190957 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 279/541] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:18 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:18.752337 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d3a768ce-8515-4931-bce9-69aea4b26974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:18.753207 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d3a768ce-8515-4931-bce9-69aea4b26974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:18.760675 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3a768ce-8515-4931-bce9-69aea4b26974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:18.761130 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3a768ce-8515-4931-bce9-69aea4b26974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:18.761902 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3a768ce-8515-4931-bce9-69aea4b26974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:18.762356 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3a768ce-8515-4931-bce9-69aea4b26974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:18.899930 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d3a768ce-8515-4931-bce9-69aea4b26974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:18.907361 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d3a768ce-8515-4931-bce9-69aea4b26974 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.158855 Aug 01 07:41:18.907994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 263/542] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:18 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:19.210297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1283cea5-f4df-48e1-9d88-d64e4c021162 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:19.210817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1283cea5-f4df-48e1-9d88-d64e4c021162 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:19.213224 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:19.218815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1283cea5-f4df-48e1-9d88-d64e4c021162 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:19.219318 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1283cea5-f4df-48e1-9d88-d64e4c021162 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:19.220074 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1283cea5-f4df-48e1-9d88-d64e4c021162 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:19.221173 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1283cea5-f4df-48e1-9d88-d64e4c021162 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:19.358986 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1283cea5-f4df-48e1-9d88-d64e4c021162 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:19.367493 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1283cea5-f4df-48e1-9d88-d64e4c021162 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.161012 Aug 01 07:41:19.368066 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 280/543] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:19 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:19.932757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b94a8e9c-eb90-4830-a87e-554159961c17 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:19.934215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b94a8e9c-eb90-4830-a87e-554159961c17 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:19.941211 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b94a8e9c-eb90-4830-a87e-554159961c17 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:19.941669 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b94a8e9c-eb90-4830-a87e-554159961c17 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:19.942479 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b94a8e9c-eb90-4830-a87e-554159961c17 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:19.943120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b94a8e9c-eb90-4830-a87e-554159961c17 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:20.087459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b94a8e9c-eb90-4830-a87e-554159961c17 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:20.095767 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b94a8e9c-eb90-4830-a87e-554159961c17 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.167164 Aug 01 07:41:20.097785 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 264/544] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:19 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:20.389621 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ea9c4efb-3d85-4b40-9e5c-382437661bed tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:20.390289 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ea9c4efb-3d85-4b40-9e5c-382437661bed tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:20.397611 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ea9c4efb-3d85-4b40-9e5c-382437661bed tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:20.398062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ea9c4efb-3d85-4b40-9e5c-382437661bed tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:20.398836 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ea9c4efb-3d85-4b40-9e5c-382437661bed tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:20.399588 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ea9c4efb-3d85-4b40-9e5c-382437661bed tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:20.538833 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ea9c4efb-3d85-4b40-9e5c-382437661bed tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:20.546269 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ea9c4efb-3d85-4b40-9e5c-382437661bed tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.161065 Aug 01 07:41:20.547196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 281/545] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:20 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:21.118668 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-14dfd3cf-22d3-42fd-b4a9-2b3c86783db5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:21.120224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-14dfd3cf-22d3-42fd-b4a9-2b3c86783db5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:21.131637 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-14dfd3cf-22d3-42fd-b4a9-2b3c86783db5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:21.132716 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-14dfd3cf-22d3-42fd-b4a9-2b3c86783db5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:21.134171 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-14dfd3cf-22d3-42fd-b4a9-2b3c86783db5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:21.135005 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-14dfd3cf-22d3-42fd-b4a9-2b3c86783db5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:21.351878 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-14dfd3cf-22d3-42fd-b4a9-2b3c86783db5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:21.359889 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-14dfd3cf-22d3-42fd-b4a9-2b3c86783db5 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.245324 Aug 01 07:41:21.360479 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 265/546] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:21 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:21.567944 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-aebbd5cc-580f-4d07-a3d6-7353a90dd649 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:21.569781 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-aebbd5cc-580f-4d07-a3d6-7353a90dd649 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:21.577401 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aebbd5cc-580f-4d07-a3d6-7353a90dd649 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:21.578130 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aebbd5cc-580f-4d07-a3d6-7353a90dd649 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:21.578963 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aebbd5cc-580f-4d07-a3d6-7353a90dd649 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:21.580279 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aebbd5cc-580f-4d07-a3d6-7353a90dd649 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:21.725102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-aebbd5cc-580f-4d07-a3d6-7353a90dd649 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:21.732768 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-aebbd5cc-580f-4d07-a3d6-7353a90dd649 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.168807 Aug 01 07:41:21.733432 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 282/547] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:21 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:22.383377 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-53a7a14b-c774-4f21-8442-2f604da95c44 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:22.383983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-53a7a14b-c774-4f21-8442-2f604da95c44 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:22.390325 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-53a7a14b-c774-4f21-8442-2f604da95c44 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:22.390783 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-53a7a14b-c774-4f21-8442-2f604da95c44 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:22.391572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-53a7a14b-c774-4f21-8442-2f604da95c44 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:22.392677 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-53a7a14b-c774-4f21-8442-2f604da95c44 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:22.396800 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:22.418541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=6 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:22.527609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-53a7a14b-c774-4f21-8442-2f604da95c44 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:22.535296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-53a7a14b-c774-4f21-8442-2f604da95c44 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.155770 Aug 01 07:41:22.535805 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 266/548] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:22 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:22.757192 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2f8e5b9a-1ee2-4e68-9b25-e3bf6a592cbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:22.757819 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2f8e5b9a-1ee2-4e68-9b25-e3bf6a592cbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:22.760154 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=6 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:22.767681 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f8e5b9a-1ee2-4e68-9b25-e3bf6a592cbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:22.768498 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f8e5b9a-1ee2-4e68-9b25-e3bf6a592cbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:22.769421 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f8e5b9a-1ee2-4e68-9b25-e3bf6a592cbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:22.769859 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f8e5b9a-1ee2-4e68-9b25-e3bf6a592cbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:22.916614 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2f8e5b9a-1ee2-4e68-9b25-e3bf6a592cbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:22.926009 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2f8e5b9a-1ee2-4e68-9b25-e3bf6a592cbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.173462 Aug 01 07:41:22.926807 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 283/549] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:22 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:23.557561 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-53752439-9331-4015-8e69-f01f03fcc261 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:23.558217 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-53752439-9331-4015-8e69-f01f03fcc261 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:23.565353 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-53752439-9331-4015-8e69-f01f03fcc261 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:23.565815 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-53752439-9331-4015-8e69-f01f03fcc261 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:23.566594 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-53752439-9331-4015-8e69-f01f03fcc261 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:23.567048 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-53752439-9331-4015-8e69-f01f03fcc261 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:23.710434 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-53752439-9331-4015-8e69-f01f03fcc261 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:23.718528 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-53752439-9331-4015-8e69-f01f03fcc261 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.165280 Aug 01 07:41:23.719120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 267/550] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:23 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:23.950698 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c0f5a2be-c7cc-42f5-aed1-f4213ae4e0a2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:23.952267 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c0f5a2be-c7cc-42f5-aed1-f4213ae4e0a2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:23.960862 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c0f5a2be-c7cc-42f5-aed1-f4213ae4e0a2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:23.961779 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c0f5a2be-c7cc-42f5-aed1-f4213ae4e0a2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:23.962743 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c0f5a2be-c7cc-42f5-aed1-f4213ae4e0a2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:23.963362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c0f5a2be-c7cc-42f5-aed1-f4213ae4e0a2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:24.175914 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c0f5a2be-c7cc-42f5-aed1-f4213ae4e0a2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:24.183279 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c0f5a2be-c7cc-42f5-aed1-f4213ae4e0a2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.237133 Aug 01 07:41:24.183835 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 284/551] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:23 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:24.741091 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9b55b135-9068-4fdd-bd11-587d84bb6236 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:24.741765 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9b55b135-9068-4fdd-bd11-587d84bb6236 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:24.751185 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b55b135-9068-4fdd-bd11-587d84bb6236 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:24.752519 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b55b135-9068-4fdd-bd11-587d84bb6236 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:24.754616 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b55b135-9068-4fdd-bd11-587d84bb6236 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:24.755157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b55b135-9068-4fdd-bd11-587d84bb6236 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:24.900481 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9b55b135-9068-4fdd-bd11-587d84bb6236 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:24.908555 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9b55b135-9068-4fdd-bd11-587d84bb6236 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.172075 Aug 01 07:41:24.909139 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 268/552] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:24 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:25.206007 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-31b555b3-b86f-42b7-b175-9c19a4ecac30 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:25.207141 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-31b555b3-b86f-42b7-b175-9c19a4ecac30 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:25.213850 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31b555b3-b86f-42b7-b175-9c19a4ecac30 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:25.214306 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31b555b3-b86f-42b7-b175-9c19a4ecac30 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:25.215097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31b555b3-b86f-42b7-b175-9c19a4ecac30 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:25.215524 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31b555b3-b86f-42b7-b175-9c19a4ecac30 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:25.351634 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-31b555b3-b86f-42b7-b175-9c19a4ecac30 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:25.359160 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-31b555b3-b86f-42b7-b175-9c19a4ecac30 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.157362 Aug 01 07:41:25.359728 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 285/553] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:25 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:25.930653 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-08e9a709-bd36-4e13-97f0-970903ff5f76 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:25.931336 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-08e9a709-bd36-4e13-97f0-970903ff5f76 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:25.938097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08e9a709-bd36-4e13-97f0-970903ff5f76 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:25.938802 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08e9a709-bd36-4e13-97f0-970903ff5f76 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:25.939621 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08e9a709-bd36-4e13-97f0-970903ff5f76 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:25.940066 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08e9a709-bd36-4e13-97f0-970903ff5f76 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:26.088125 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-08e9a709-bd36-4e13-97f0-970903ff5f76 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:26.095844 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-08e9a709-bd36-4e13-97f0-970903ff5f76 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.169117 Aug 01 07:41:26.096413 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 269/554] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:25 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:26.381846 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-cbd339b6-f095-4a10-a74a-c87d5e8c684c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:26.382717 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-cbd339b6-f095-4a10-a74a-c87d5e8c684c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:26.389380 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cbd339b6-f095-4a10-a74a-c87d5e8c684c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:26.389837 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cbd339b6-f095-4a10-a74a-c87d5e8c684c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:26.390610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cbd339b6-f095-4a10-a74a-c87d5e8c684c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:26.391054 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cbd339b6-f095-4a10-a74a-c87d5e8c684c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:26.410890 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=100 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:26.537069 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-cbd339b6-f095-4a10-a74a-c87d5e8c684c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:26.544972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-cbd339b6-f095-4a10-a74a-c87d5e8c684c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.167785 Aug 01 07:41:26.557633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 286/555] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:26 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:27.117558 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-14952af7-585b-4c9b-8b02-22dcd373cb70 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:27.118158 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-14952af7-585b-4c9b-8b02-22dcd373cb70 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:27.124584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-14952af7-585b-4c9b-8b02-22dcd373cb70 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:27.125026 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-14952af7-585b-4c9b-8b02-22dcd373cb70 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:27.125776 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-14952af7-585b-4c9b-8b02-22dcd373cb70 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:27.126208 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-14952af7-585b-4c9b-8b02-22dcd373cb70 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:27.254689 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-14952af7-585b-4c9b-8b02-22dcd373cb70 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:27.262113 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-14952af7-585b-4c9b-8b02-22dcd373cb70 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1679 microversion: 2.1 time: 0.148385 Aug 01 07:41:27.262673 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 270/556] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:27 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:27.567527 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f9a3f8a7-5d16-49d5-8d16-92da1d926cc6 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:27.568099 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f9a3f8a7-5d16-49d5-8d16-92da1d926cc6 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:27.574663 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f9a3f8a7-5d16-49d5-8d16-92da1d926cc6 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:27.575140 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f9a3f8a7-5d16-49d5-8d16-92da1d926cc6 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:27.575897 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f9a3f8a7-5d16-49d5-8d16-92da1d926cc6 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:27.576330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f9a3f8a7-5d16-49d5-8d16-92da1d926cc6 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:27.715567 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f9a3f8a7-5d16-49d5-8d16-92da1d926cc6 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:27.732060 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f9a3f8a7-5d16-49d5-8d16-92da1d926cc6 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.168885 Aug 01 07:41:27.733143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 287/557] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:27 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:28.283871 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-30b15734-a277-4ae9-820f-a7d7eb40af05 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:28.285519 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-30b15734-a277-4ae9-820f-a7d7eb40af05 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:28.291842 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-30b15734-a277-4ae9-820f-a7d7eb40af05 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:28.292293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-30b15734-a277-4ae9-820f-a7d7eb40af05 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:28.293050 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-30b15734-a277-4ae9-820f-a7d7eb40af05 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:28.293483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-30b15734-a277-4ae9-820f-a7d7eb40af05 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:28.434414 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-3b5123e5-a88e-414e-b13f-b6382b274685 req-6a7c0509-7772-46c0-9a91-b4bf20837de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587f64fe-aa07-43ef-942a-883dfa6b585c", "tag": "2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:28.444759 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-3b5123e5-a88e-414e-b13f-b6382b274685 req-6a7c0509-7772-46c0-9a91-b4bf20837de2 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:28.445205 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-3b5123e5-a88e-414e-b13f-b6382b274685 req-6a7c0509-7772-46c0-9a91-b4bf20837de2 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:28.457033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-3b5123e5-a88e-414e-b13f-b6382b274685 req-6a7c0509-7772-46c0-9a91-b4bf20837de2 service nova] Creating event network-changed:2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f for instance 587f64fe-aa07-43ef-942a-883dfa6b585c on hv-cinder-73306 Aug 01 07:41:28.462172 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-3b5123e5-a88e-414e-b13f-b6382b274685 req-6a7c0509-7772-46c0-9a91-b4bf20837de2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031606 Aug 01 07:41:28.462938 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 288/558] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:41:28.529037 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-30b15734-a277-4ae9-820f-a7d7eb40af05 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:28.537785 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-30b15734-a277-4ae9-820f-a7d7eb40af05 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1656 microversion: 2.1 time: 0.257647 Aug 01 07:41:28.538459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 271/559] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:28 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1656 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:28.558755 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b2072472-2438-4b62-ad5a-9e95f9b7417f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:28.565103 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b2072472-2438-4b62-ad5a-9e95f9b7417f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:28.565586 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b2072472-2438-4b62-ad5a-9e95f9b7417f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:28.588441 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b2072472-2438-4b62-ad5a-9e95f9b7417f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Going to try to start instance {{(pid=124279) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 07:41:28.632311 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b2072472-2438-4b62-ad5a-9e95f9b7417f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/action" status: 202 len: 0 microversion: 2.1 time: 0.077622 Aug 01 07:41:28.632928 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 289/560] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:41:28 2022] POST /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:41:28.640878 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9038bcc2-d553-4f8b-bda9-332b760812ad tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:28.641491 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9038bcc2-d553-4f8b-bda9-332b760812ad tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:28.648360 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9038bcc2-d553-4f8b-bda9-332b760812ad tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:28.648815 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9038bcc2-d553-4f8b-bda9-332b760812ad tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:28.649778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9038bcc2-d553-4f8b-bda9-332b760812ad tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:28.650394 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9038bcc2-d553-4f8b-bda9-332b760812ad tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:28.670403 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:28.755775 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-72b4febb-e61d-43d1-8024-71156cbf866e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:28.756411 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-72b4febb-e61d-43d1-8024-71156cbf866e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:28.762640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-72b4febb-e61d-43d1-8024-71156cbf866e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:28.763150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-72b4febb-e61d-43d1-8024-71156cbf866e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:28.763916 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-72b4febb-e61d-43d1-8024-71156cbf866e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:28.764355 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-72b4febb-e61d-43d1-8024-71156cbf866e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:28.902506 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-72b4febb-e61d-43d1-8024-71156cbf866e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:28.910584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-72b4febb-e61d-43d1-8024-71156cbf866e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.159915 Aug 01 07:41:28.911189 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 290/561] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:28 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:28.915866 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bca7feb4-e495-408a-a5cc-1b6d01578837 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:28.916357 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-bca7feb4-e495-408a-a5cc-1b6d01578837 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:28.922563 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bca7feb4-e495-408a-a5cc-1b6d01578837 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:28.923007 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bca7feb4-e495-408a-a5cc-1b6d01578837 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:28.923829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bca7feb4-e495-408a-a5cc-1b6d01578837 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:28.924262 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bca7feb4-e495-408a-a5cc-1b6d01578837 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:29.054605 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-bca7feb4-e495-408a-a5cc-1b6d01578837 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lazy-loading 'services' on Instance uuid 454081a2-dd82-4a94-9e68-1133673dbb5d {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:41:29.171540 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-bca7feb4-e495-408a-a5cc-1b6d01578837 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "DELETE /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d/os-volume_attachments/c823bf18-e9a3-44fd-bf38-a981bda3ec93" status: 202 len: 0 microversion: 2.1 time: 0.258546 Aug 01 07:41:29.172302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 291/562] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:41:28 2022] DELETE /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d/os-volume_attachments/c823bf18-e9a3-44fd-bf38-a981bda3ec93 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:41:29.203917 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9038bcc2-d553-4f8b-bda9-332b760812ad tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:29.214157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9038bcc2-d553-4f8b-bda9-332b760812ad tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1665 microversion: 2.1 time: 0.576987 Aug 01 07:41:29.214734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 272/563] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:28 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1665 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:29.932759 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b6f38046-a538-4762-b701-38fe5df6cbe1 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:29.933457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b6f38046-a538-4762-b701-38fe5df6cbe1 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:29.941573 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b6f38046-a538-4762-b701-38fe5df6cbe1 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:29.942033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b6f38046-a538-4762-b701-38fe5df6cbe1 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:29.942801 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b6f38046-a538-4762-b701-38fe5df6cbe1 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:29.943273 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b6f38046-a538-4762-b701-38fe5df6cbe1 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:30.076288 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b6f38046-a538-4762-b701-38fe5df6cbe1 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:30.083942 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b6f38046-a538-4762-b701-38fe5df6cbe1 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.155398 Aug 01 07:41:30.084509 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 292/564] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:29 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:30.235736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-23721584-d78f-495d-a313-3d1634ab992a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:30.236281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-23721584-d78f-495d-a313-3d1634ab992a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:30.243347 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-23721584-d78f-495d-a313-3d1634ab992a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:30.243805 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-23721584-d78f-495d-a313-3d1634ab992a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:30.244569 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-23721584-d78f-495d-a313-3d1634ab992a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:30.245012 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-23721584-d78f-495d-a313-3d1634ab992a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:30.375685 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-23721584-d78f-495d-a313-3d1634ab992a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:30.383911 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-23721584-d78f-495d-a313-3d1634ab992a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1665 microversion: 2.1 time: 0.152089 Aug 01 07:41:30.384478 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 273/565] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:30 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:31.106436 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c0cd0674-b301-4ee3-bbf1-1b07595f08da tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:31.107046 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c0cd0674-b301-4ee3-bbf1-1b07595f08da tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:31.114352 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c0cd0674-b301-4ee3-bbf1-1b07595f08da tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:31.115046 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c0cd0674-b301-4ee3-bbf1-1b07595f08da tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:31.116030 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c0cd0674-b301-4ee3-bbf1-1b07595f08da tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:31.116473 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c0cd0674-b301-4ee3-bbf1-1b07595f08da tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:31.264984 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c0cd0674-b301-4ee3-bbf1-1b07595f08da tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:31.273039 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c0cd0674-b301-4ee3-bbf1-1b07595f08da tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.171030 Aug 01 07:41:31.273647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 293/566] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:31 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:31.367996 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-556680dc-de75-4942-b360-4e7b7f26f168 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:31.368495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-556680dc-de75-4942-b360-4e7b7f26f168 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:31.379763 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-556680dc-de75-4942-b360-4e7b7f26f168 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:31.380210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-556680dc-de75-4942-b360-4e7b7f26f168 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:31.380995 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-556680dc-de75-4942-b360-4e7b7f26f168 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:31.381439 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-556680dc-de75-4942-b360-4e7b7f26f168 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:31.405677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f7bc5e8c-ca51-4b7e-a0a9-e745f15e6abf tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:31.406460 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f7bc5e8c-ca51-4b7e-a0a9-e745f15e6abf tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:31.406994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-556680dc-de75-4942-b360-4e7b7f26f168 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Going to try to terminate instance {{(pid=124280) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:41:31.412629 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f7bc5e8c-ca51-4b7e-a0a9-e745f15e6abf tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:31.413082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f7bc5e8c-ca51-4b7e-a0a9-e745f15e6abf tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:31.413855 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f7bc5e8c-ca51-4b7e-a0a9-e745f15e6abf tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:31.414292 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f7bc5e8c-ca51-4b7e-a0a9-e745f15e6abf tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:31.500548 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-556680dc-de75-4942-b360-4e7b7f26f168 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "DELETE /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 204 len: 0 microversion: 2.1 time: 0.136113 Aug 01 07:41:31.505203 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 274/567] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:41:31 2022] DELETE /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:41:31.512983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a5c6390e-fcdf-40fa-9208-beaa0483dc48 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:31.514186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a5c6390e-fcdf-40fa-9208-beaa0483dc48 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:31.520676 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a5c6390e-fcdf-40fa-9208-beaa0483dc48 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:31.521133 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a5c6390e-fcdf-40fa-9208-beaa0483dc48 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:31.522289 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a5c6390e-fcdf-40fa-9208-beaa0483dc48 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:31.522741 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a5c6390e-fcdf-40fa-9208-beaa0483dc48 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:31.561500 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f7bc5e8c-ca51-4b7e-a0a9-e745f15e6abf tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:31.569347 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f7bc5e8c-ca51-4b7e-a0a9-e745f15e6abf tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1665 microversion: 2.1 time: 0.167384 Aug 01 07:41:31.570027 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 294/568] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:31 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:31.656863 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a5c6390e-fcdf-40fa-9208-beaa0483dc48 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:31.664982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a5c6390e-fcdf-40fa-9208-beaa0483dc48 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1514 microversion: 2.1 time: 0.158453 Aug 01 07:41:31.665552 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 275/569] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:31 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:32.295344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c32506c7-09eb-4e48-8b5b-99e1bdc1db8d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:32.295953 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c32506c7-09eb-4e48-8b5b-99e1bdc1db8d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:32.302405 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c32506c7-09eb-4e48-8b5b-99e1bdc1db8d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:32.302859 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c32506c7-09eb-4e48-8b5b-99e1bdc1db8d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:32.303660 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c32506c7-09eb-4e48-8b5b-99e1bdc1db8d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:32.304106 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c32506c7-09eb-4e48-8b5b-99e1bdc1db8d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:32.437394 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c32506c7-09eb-4e48-8b5b-99e1bdc1db8d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:32.445732 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c32506c7-09eb-4e48-8b5b-99e1bdc1db8d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.154231 Aug 01 07:41:32.446646 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 295/570] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:32 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:32.591183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0519a808-b2b2-435e-90d7-eb1ab9d82136 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:32.591704 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0519a808-b2b2-435e-90d7-eb1ab9d82136 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:32.598296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0519a808-b2b2-435e-90d7-eb1ab9d82136 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:32.598747 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0519a808-b2b2-435e-90d7-eb1ab9d82136 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:32.599563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0519a808-b2b2-435e-90d7-eb1ab9d82136 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:32.600005 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0519a808-b2b2-435e-90d7-eb1ab9d82136 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:32.686422 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c886e0ab-5857-4e8d-bdd9-0bf5c5bc2844 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:32.687140 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c886e0ab-5857-4e8d-bdd9-0bf5c5bc2844 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:32.694090 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c886e0ab-5857-4e8d-bdd9-0bf5c5bc2844 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:32.694526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c886e0ab-5857-4e8d-bdd9-0bf5c5bc2844 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:32.695333 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c886e0ab-5857-4e8d-bdd9-0bf5c5bc2844 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:32.695768 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c886e0ab-5857-4e8d-bdd9-0bf5c5bc2844 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:32.733150 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0519a808-b2b2-435e-90d7-eb1ab9d82136 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:32.741240 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0519a808-b2b2-435e-90d7-eb1ab9d82136 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1665 microversion: 2.1 time: 0.153986 Aug 01 07:41:32.741824 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 276/571] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:32 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:32.828133 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c886e0ab-5857-4e8d-bdd9-0bf5c5bc2844 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:32.835699 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c886e0ab-5857-4e8d-bdd9-0bf5c5bc2844 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1514 microversion: 2.1 time: 0.153851 Aug 01 07:41:32.836259 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 296/572] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:32 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:33.467112 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1ae66cfc-9bb2-4993-aaa8-64603a6abb38 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:33.467720 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1ae66cfc-9bb2-4993-aaa8-64603a6abb38 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:33.474311 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1ae66cfc-9bb2-4993-aaa8-64603a6abb38 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:33.474764 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1ae66cfc-9bb2-4993-aaa8-64603a6abb38 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:33.475565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1ae66cfc-9bb2-4993-aaa8-64603a6abb38 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:33.476190 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1ae66cfc-9bb2-4993-aaa8-64603a6abb38 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:33.602199 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1ae66cfc-9bb2-4993-aaa8-64603a6abb38 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:33.609506 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1ae66cfc-9bb2-4993-aaa8-64603a6abb38 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.146222 Aug 01 07:41:33.610075 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 277/573] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:33 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:33.763363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-89ac5bad-8082-4834-9948-3c5e55a23889 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:33.763896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-89ac5bad-8082-4834-9948-3c5e55a23889 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:33.771339 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-89ac5bad-8082-4834-9948-3c5e55a23889 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:33.771798 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-89ac5bad-8082-4834-9948-3c5e55a23889 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:33.772598 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-89ac5bad-8082-4834-9948-3c5e55a23889 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:33.773038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-89ac5bad-8082-4834-9948-3c5e55a23889 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:33.857455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b67b81f3-8292-497a-8dd5-74ad6fbf637c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:33.858063 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b67b81f3-8292-497a-8dd5-74ad6fbf637c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:33.865545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b67b81f3-8292-497a-8dd5-74ad6fbf637c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:33.866004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b67b81f3-8292-497a-8dd5-74ad6fbf637c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:33.866796 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b67b81f3-8292-497a-8dd5-74ad6fbf637c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:33.867273 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b67b81f3-8292-497a-8dd5-74ad6fbf637c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:34.007921 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b67b81f3-8292-497a-8dd5-74ad6fbf637c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:34.016177 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b67b81f3-8292-497a-8dd5-74ad6fbf637c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1514 microversion: 2.1 time: 0.162472 Aug 01 07:41:34.016683 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 278/574] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:33 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:34.086503 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-89ac5bad-8082-4834-9948-3c5e55a23889 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:34.093968 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-89ac5bad-8082-4834-9948-3c5e55a23889 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1669 microversion: 2.1 time: 0.334640 Aug 01 07:41:34.094534 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 297/575] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:33 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1669 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:34.432193 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-066882d0-c88d-4a33-a00c-cd0924f21a90 req-b1fa1699-674d-490f-a46e-cacc1e56ae3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587f64fe-aa07-43ef-942a-883dfa6b585c", "name": "network-vif-plugged", "status": "completed", "tag": "2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:34.442086 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-066882d0-c88d-4a33-a00c-cd0924f21a90 req-b1fa1699-674d-490f-a46e-cacc1e56ae3b service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:34.442798 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-066882d0-c88d-4a33-a00c-cd0924f21a90 req-b1fa1699-674d-490f-a46e-cacc1e56ae3b service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:34.459414 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-066882d0-c88d-4a33-a00c-cd0924f21a90 req-b1fa1699-674d-490f-a46e-cacc1e56ae3b service nova] Creating event network-vif-plugged:2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f for instance 587f64fe-aa07-43ef-942a-883dfa6b585c on hv-cinder-73306 Aug 01 07:41:34.465389 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-066882d0-c88d-4a33-a00c-cd0924f21a90 req-b1fa1699-674d-490f-a46e-cacc1e56ae3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037211 Aug 01 07:41:34.466134 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 279/576] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:34.531524 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-f6cfb013-d58d-44ec-bb40-48b296bb712d req-b9342e7c-3318-46bc-b592-2428f22f53a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454081a2-dd82-4a94-9e68-1133673dbb5d", "name": "network-vif-deleted", "tag": "e77df30b-cc0f-41e2-8917-65896ef59884"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:34.543048 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-f6cfb013-d58d-44ec-bb40-48b296bb712d req-b9342e7c-3318-46bc-b592-2428f22f53a0 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:34.543516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-f6cfb013-d58d-44ec-bb40-48b296bb712d req-b9342e7c-3318-46bc-b592-2428f22f53a0 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:34.556085 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-f6cfb013-d58d-44ec-bb40-48b296bb712d req-b9342e7c-3318-46bc-b592-2428f22f53a0 service nova] Creating event network-vif-deleted:e77df30b-cc0f-41e2-8917-65896ef59884 for instance 454081a2-dd82-4a94-9e68-1133673dbb5d on hv-cinder-73306 Aug 01 07:41:34.561299 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-f6cfb013-d58d-44ec-bb40-48b296bb712d req-b9342e7c-3318-46bc-b592-2428f22f53a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033393 Aug 01 07:41:34.561905 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 298/577] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:34.630722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b12e238b-4f7b-48a1-84b5-df39319c6ee4 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:34.631457 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b12e238b-4f7b-48a1-84b5-df39319c6ee4 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:34.637756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b12e238b-4f7b-48a1-84b5-df39319c6ee4 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:34.638207 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b12e238b-4f7b-48a1-84b5-df39319c6ee4 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:34.638974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b12e238b-4f7b-48a1-84b5-df39319c6ee4 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:34.639443 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b12e238b-4f7b-48a1-84b5-df39319c6ee4 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:34.795729 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b12e238b-4f7b-48a1-84b5-df39319c6ee4 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:34.803869 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b12e238b-4f7b-48a1-84b5-df39319c6ee4 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.177603 Aug 01 07:41:34.804465 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 280/578] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:34 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:35.039058 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:35.039829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:35.046405 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:35.046670 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:35.047531 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:35.048055 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:35.081426 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:35.081877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:35.082325 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lazy-loading 'fault' on Instance uuid 454081a2-dd82-4a94-9e68-1133673dbb5d {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:41:35.127259 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:35.135182 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-39c9f882-47a9-4054-b36c-e62e546e9398 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 200 len: 1309 microversion: 2.1 time: 0.101712 Aug 01 07:41:35.135747 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 299/579] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:35 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:35.824571 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2dbad3f6-72aa-42aa-8ad1-fd7ce3f39fbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:35.825114 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2dbad3f6-72aa-42aa-8ad1-fd7ce3f39fbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:35.831918 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2dbad3f6-72aa-42aa-8ad1-fd7ce3f39fbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:35.832378 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2dbad3f6-72aa-42aa-8ad1-fd7ce3f39fbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:35.833156 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2dbad3f6-72aa-42aa-8ad1-fd7ce3f39fbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:35.833598 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2dbad3f6-72aa-42aa-8ad1-fd7ce3f39fbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:35.970279 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2dbad3f6-72aa-42aa-8ad1-fd7ce3f39fbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:35.979876 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2dbad3f6-72aa-42aa-8ad1-fd7ce3f39fbf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.159191 Aug 01 07:41:35.980682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 281/580] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:35 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:36.156682 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7477fad3-81a1-41cb-b624-081691ee3d28 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:36.157616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7477fad3-81a1-41cb-b624-081691ee3d28 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: 454081a2-dd82-4a94-9e68-1133673dbb5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:36.164637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7477fad3-81a1-41cb-b624-081691ee3d28 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:36.165087 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7477fad3-81a1-41cb-b624-081691ee3d28 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:36.165848 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7477fad3-81a1-41cb-b624-081691ee3d28 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:36.166280 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7477fad3-81a1-41cb-b624-081691ee3d28 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:36.180311 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-7477fad3-81a1-41cb-b624-081691ee3d28 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] HTTP exception thrown: Instance 454081a2-dd82-4a94-9e68-1133673dbb5d could not be found. Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7477fad3-81a1-41cb-b624-081691ee3d28 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Request method failure captured: Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d HTTP/1.1 Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54NZUHj3O8Gb9hDrv8an_je-I0Qc0EYf5onU5JipZEYqFkkDiNsou5u5kJWZh0I-M3WF6IM5C8OGls9GmbjsuVstoNP5MIg0UcnzAZybEG_HAhNJCaAfrQEh3dCJSTHnNbqhnUkMAm8tmnyXP1mTj1oSRQK6Ajs91MjLho0iwiKajvo Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 4a76209de52146bf8440fddcdd00b284 Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-VolumesSnapshotTestJSON-676098174 Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:41:36.181933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a76209de52146bf8440fddcdd00b284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a76209de52146bf8440fddcdd00b284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a76209de52146bf8440fddcdd00b284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a76209de52146bf8440fddcdd00b284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-VolumesSnapshotTestJSON-676098174 Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 4a76209de52146bf8440fddcdd00b284 Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-676098174 Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-VolumesSnapshotTestJSON-676098174-project Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 42a2bc662fa4405791532ebf2bce909c Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-VolumesSnapshotTestJSON-676098174-project Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 454081a2-dd82-4a94-9e68-1133673dbb5d could not be found. Aug 01 07:41:36.183517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '454081a2-dd82-4a94-9e68-1133673dbb5d'} Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454081a2-dd82-4a94-9e68-1133673dbb5d could not be found. Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:41:36.184642 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454081a2-dd82-4a94-9e68-1133673dbb5d could not be found. Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454081a2-dd82-4a94-9e68-1133673dbb5d could not be found. Aug 01 07:41:36.186097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:41:36.187414 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7477fad3-81a1-41cb-b624-081691ee3d28 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Returning 404 to user: Instance 454081a2-dd82-4a94-9e68-1133673dbb5d could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:41:36.187414 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7477fad3-81a1-41cb-b624-081691ee3d28 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d" status: 404 len: 111 microversion: 2.1 time: 0.030614 Aug 01 07:41:36.187414 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 300/581] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:36 2022] GET /compute/v2.1/servers/454081a2-dd82-4a94-9e68-1133673dbb5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:41:37.002810 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a49e8344-f1a0-40ce-b3ba-061de1ea1a1c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:37.003457 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a49e8344-f1a0-40ce-b3ba-061de1ea1a1c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:37.009907 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a49e8344-f1a0-40ce-b3ba-061de1ea1a1c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:37.010363 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a49e8344-f1a0-40ce-b3ba-061de1ea1a1c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:37.011153 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a49e8344-f1a0-40ce-b3ba-061de1ea1a1c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:37.011596 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a49e8344-f1a0-40ce-b3ba-061de1ea1a1c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:37.147990 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a49e8344-f1a0-40ce-b3ba-061de1ea1a1c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:37.155492 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a49e8344-f1a0-40ce-b3ba-061de1ea1a1c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.156957 Aug 01 07:41:37.156038 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 282/582] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:36 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:37.544370 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-79a0c784-8279-493a-90c3-167ec3f0ea7e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c284000c-5005-49f6-91fe-6ca78aa4b59f"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:37.548036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-79a0c784-8279-493a-90c3-167ec3f0ea7e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:37.555887 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79a0c784-8279-493a-90c3-167ec3f0ea7e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:37.556339 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79a0c784-8279-493a-90c3-167ec3f0ea7e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:37.557104 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79a0c784-8279-493a-90c3-167ec3f0ea7e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:37.557539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79a0c784-8279-493a-90c3-167ec3f0ea7e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:38.176272 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ee0feea4-3e0f-485f-b002-4ec09f6c0f68 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:38.176861 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ee0feea4-3e0f-485f-b002-4ec09f6c0f68 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:38.183290 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ee0feea4-3e0f-485f-b002-4ec09f6c0f68 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:38.183742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ee0feea4-3e0f-485f-b002-4ec09f6c0f68 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:38.184497 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ee0feea4-3e0f-485f-b002-4ec09f6c0f68 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:38.184927 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ee0feea4-3e0f-485f-b002-4ec09f6c0f68 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:38.317038 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ee0feea4-3e0f-485f-b002-4ec09f6c0f68 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:38.324494 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ee0feea4-3e0f-485f-b002-4ec09f6c0f68 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.152298 Aug 01 07:41:38.325049 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 283/583] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:38 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:39.351671 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9b21bc7a-1842-49b2-b77e-fd6240a61a19 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:39.352320 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9b21bc7a-1842-49b2-b77e-fd6240a61a19 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:39.358820 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b21bc7a-1842-49b2-b77e-fd6240a61a19 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:39.359319 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b21bc7a-1842-49b2-b77e-fd6240a61a19 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:39.360097 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b21bc7a-1842-49b2-b77e-fd6240a61a19 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:39.360539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b21bc7a-1842-49b2-b77e-fd6240a61a19 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:39.519916 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9b21bc7a-1842-49b2-b77e-fd6240a61a19 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:39.528201 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9b21bc7a-1842-49b2-b77e-fd6240a61a19 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1359 microversion: 2.1 time: 0.180242 Aug 01 07:41:39.529226 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 284/584] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:39 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:39.711867 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:39.725063 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-79a0c784-8279-493a-90c3-167ec3f0ea7e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.185378 Aug 01 07:41:39.725707 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 301/585] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:41:37 2022] POST /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments => generated 194 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:39.741585 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1746d5c9-8e3f-4705-966e-4a5a8c294c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:39.742092 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1746d5c9-8e3f-4705-966e-4a5a8c294c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:39.756090 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1746d5c9-8e3f-4705-966e-4a5a8c294c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:39.756544 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1746d5c9-8e3f-4705-966e-4a5a8c294c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:39.757330 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1746d5c9-8e3f-4705-966e-4a5a8c294c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:39.757772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1746d5c9-8e3f-4705-966e-4a5a8c294c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:39.789487 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1746d5c9-8e3f-4705-966e-4a5a8c294c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments/0a0cf0e4-15ba-4f1c-a510-676bd36fb19a" status: 200 len: 194 microversion: 2.20 time: 0.051796 Aug 01 07:41:39.790090 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 285/586] 10.222.0.40 () {60 vars in 1454 bytes} [Mon Aug 1 07:41:39 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments/0a0cf0e4-15ba-4f1c-a510-676bd36fb19a => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:41:39.866709 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c743b8ac-c2c1-41eb-8534-31a90cc77eb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:39.867367 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c743b8ac-c2c1-41eb-8534-31a90cc77eb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:39.874860 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c743b8ac-c2c1-41eb-8534-31a90cc77eb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:39.875618 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c743b8ac-c2c1-41eb-8534-31a90cc77eb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:39.876108 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c743b8ac-c2c1-41eb-8534-31a90cc77eb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:39.876544 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c743b8ac-c2c1-41eb-8534-31a90cc77eb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:39.959984 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-c743b8ac-c2c1-41eb-8534-31a90cc77eb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lazy-loading 'services' on Instance uuid 8ff143cc-5a30-44be-a327-29eaacf61348 {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:41:40.034966 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c743b8ac-c2c1-41eb-8534-31a90cc77eb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments/0a0cf0e4-15ba-4f1c-a510-676bd36fb19a" status: 202 len: 0 microversion: 2.20 time: 0.172406 Aug 01 07:41:40.035521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 302/587] 10.222.0.40 () {60 vars in 1457 bytes} [Mon Aug 1 07:41:39 2022] DELETE /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments/0a0cf0e4-15ba-4f1c-a510-676bd36fb19a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 07:41:40.044128 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-883890c2-600b-41cb-bf85-a7e1d9988702 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:40.046352 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-883890c2-600b-41cb-bf85-a7e1d9988702 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:40.052628 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-883890c2-600b-41cb-bf85-a7e1d9988702 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:40.053062 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-883890c2-600b-41cb-bf85-a7e1d9988702 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:40.053925 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-883890c2-600b-41cb-bf85-a7e1d9988702 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:40.054557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-883890c2-600b-41cb-bf85-a7e1d9988702 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:40.089976 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-883890c2-600b-41cb-bf85-a7e1d9988702 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049657 Aug 01 07:41:40.090629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 286/588] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 1 07:41:40 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:41:40.551165 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-000fca80-f3b0-4769-ad31-d5b375b1702a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:40.552244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-000fca80-f3b0-4769-ad31-d5b375b1702a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:40.558985 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-000fca80-f3b0-4769-ad31-d5b375b1702a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:40.559465 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-000fca80-f3b0-4769-ad31-d5b375b1702a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:40.560324 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-000fca80-f3b0-4769-ad31-d5b375b1702a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:40.560763 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-000fca80-f3b0-4769-ad31-d5b375b1702a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:40.699882 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-000fca80-f3b0-4769-ad31-d5b375b1702a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:40.708917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-000fca80-f3b0-4769-ad31-d5b375b1702a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1549 microversion: 2.1 time: 0.162944 Aug 01 07:41:40.709464 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 303/589] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:40 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:40.728977 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-880ad54a-64c6-4fee-825f-d6a08d18eb99 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:40.729504 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-880ad54a-64c6-4fee-825f-d6a08d18eb99 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:40.735900 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-880ad54a-64c6-4fee-825f-d6a08d18eb99 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:40.736347 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-880ad54a-64c6-4fee-825f-d6a08d18eb99 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:40.737755 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-880ad54a-64c6-4fee-825f-d6a08d18eb99 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:40.738188 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-880ad54a-64c6-4fee-825f-d6a08d18eb99 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:40.873197 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-880ad54a-64c6-4fee-825f-d6a08d18eb99 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:40.881230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-880ad54a-64c6-4fee-825f-d6a08d18eb99 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1549 microversion: 2.1 time: 0.156076 Aug 01 07:41:40.881838 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 287/590] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:40 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:40.903971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-de181b75-355f-407a-84a4-72e901b4c77e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:40.909033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-de181b75-355f-407a-84a4-72e901b4c77e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:40.910502 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-de181b75-355f-407a-84a4-72e901b4c77e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Searching by: {'deleted': False, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146'} {{(pid=124279) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 07:41:40.917184 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de181b75-355f-407a-84a4-72e901b4c77e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:40.917629 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de181b75-355f-407a-84a4-72e901b4c77e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:40.918421 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de181b75-355f-407a-84a4-72e901b4c77e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:40.918859 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de181b75-355f-407a-84a4-72e901b4c77e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:41.009625 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.multi_cell_list [None req-de181b75-355f-407a-84a4-72e901b4c77e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124279) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 07:41:41.103415 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d11d977c-aea9-46ad-a5fd-e96becf2174c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:41.105520 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-de181b75-355f-407a-84a4-72e901b4c77e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205275 Aug 01 07:41:41.105662 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d11d977c-aea9-46ad-a5fd-e96becf2174c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:41.106101 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 304/591] 10.222.0.40 () {58 vars in 1125 bytes} [Mon Aug 1 07:41:40 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:41.113695 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d11d977c-aea9-46ad-a5fd-e96becf2174c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:41.114593 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d11d977c-aea9-46ad-a5fd-e96becf2174c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:41.115622 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d11d977c-aea9-46ad-a5fd-e96becf2174c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:41.116073 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d11d977c-aea9-46ad-a5fd-e96becf2174c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:41.118013 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9fd31451-d948-437e-8276-e975d70e7716 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:41.118622 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9fd31451-d948-437e-8276-e975d70e7716 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:41.120180 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:41.124870 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9fd31451-d948-437e-8276-e975d70e7716 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:41.125322 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9fd31451-d948-437e-8276-e975d70e7716 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:41.126093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9fd31451-d948-437e-8276-e975d70e7716 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:41.126530 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9fd31451-d948-437e-8276-e975d70e7716 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:41.152991 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d11d977c-aea9-46ad-a5fd-e96becf2174c tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053434 Aug 01 07:41:41.153922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 288/592] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 1 07:41:41 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:41:41.270582 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9fd31451-d948-437e-8276-e975d70e7716 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:41.278224 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9fd31451-d948-437e-8276-e975d70e7716 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1549 microversion: 2.1 time: 0.164338 Aug 01 07:41:41.278793 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 305/593] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:41 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:42.165754 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c6c67687-b16a-4bbf-9fdd-968db7c26088 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:42.167804 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c6c67687-b16a-4bbf-9fdd-968db7c26088 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:42.170114 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:42.175780 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c6c67687-b16a-4bbf-9fdd-968db7c26088 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:42.176227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c6c67687-b16a-4bbf-9fdd-968db7c26088 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:42.176988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c6c67687-b16a-4bbf-9fdd-968db7c26088 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:42.177429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c6c67687-b16a-4bbf-9fdd-968db7c26088 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:42.207840 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c6c67687-b16a-4bbf-9fdd-968db7c26088 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046113 Aug 01 07:41:42.208398 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 289/594] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 1 07:41:42 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:41:42.829138 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-01410603-1717-4d44-a21b-c639b68ba03f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c24aee5-9625-4455-8f4e-5d92bd582a2e"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:42.832396 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-01410603-1717-4d44-a21b-c639b68ba03f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:42.838959 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-01410603-1717-4d44-a21b-c639b68ba03f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:42.839443 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-01410603-1717-4d44-a21b-c639b68ba03f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:42.840206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-01410603-1717-4d44-a21b-c639b68ba03f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:42.840640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-01410603-1717-4d44-a21b-c639b68ba03f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:43.220079 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b93312e8-f8c6-4a56-9647-f8ac1142522f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:43.222897 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b93312e8-f8c6-4a56-9647-f8ac1142522f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:43.229904 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b93312e8-f8c6-4a56-9647-f8ac1142522f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:43.230358 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b93312e8-f8c6-4a56-9647-f8ac1142522f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:43.231206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b93312e8-f8c6-4a56-9647-f8ac1142522f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:43.231584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b93312e8-f8c6-4a56-9647-f8ac1142522f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:43.261394 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b93312e8-f8c6-4a56-9647-f8ac1142522f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045310 Aug 01 07:41:43.263101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 290/595] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 1 07:41:43 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:41:44.274026 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f5cfa1e2-b057-42df-adb8-4b5bf60e3450 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:44.276147 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f5cfa1e2-b057-42df-adb8-4b5bf60e3450 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:44.282563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f5cfa1e2-b057-42df-adb8-4b5bf60e3450 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:44.283016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f5cfa1e2-b057-42df-adb8-4b5bf60e3450 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:44.284505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f5cfa1e2-b057-42df-adb8-4b5bf60e3450 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:44.284954 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f5cfa1e2-b057-42df-adb8-4b5bf60e3450 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:44.313688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f5cfa1e2-b057-42df-adb8-4b5bf60e3450 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043758 Aug 01 07:41:44.314232 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 291/596] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 1 07:41:44 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:41:44.909574 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-01410603-1717-4d44-a21b-c639b68ba03f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "POST /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.083500 Aug 01 07:41:44.910433 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 306/597] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:41:42 2022] POST /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments => generated 194 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:45.089772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-358499478", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "networks": [{"uuid": "959bdb5b-127a-43d6-95d7-60fefef1792f"}]}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:45.142197 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] validate_networks() for [('959bdb5b-127a-43d6-95d7-60fefef1792f', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:41:45.327315 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-761f3f30-a8f3-4fb1-a3a6-1dabb8488bc5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:45.329484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-761f3f30-a8f3-4fb1-a3a6-1dabb8488bc5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:45.336281 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-761f3f30-a8f3-4fb1-a3a6-1dabb8488bc5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:45.336724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-761f3f30-a8f3-4fb1-a3a6-1dabb8488bc5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:45.337484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-761f3f30-a8f3-4fb1-a3a6-1dabb8488bc5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:45.337914 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-761f3f30-a8f3-4fb1-a3a6-1dabb8488bc5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:45.367443 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-761f3f30-a8f3-4fb1-a3a6-1dabb8488bc5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045218 Aug 01 07:41:45.368001 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 307/598] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 1 07:41:45 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:41:45.489910 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:41:45.490390 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:41:45.490838 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:41:45.491305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:41:45.491726 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:41:45.500621 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:45.501079 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:45.501881 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:45.503153 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:45.519573 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Getting quotas for project 4a76209de52146bf8440fddcdd00b284. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:41:45.523534 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Getting quotas for user 42a2bc662fa4405791532ebf2bce909c and project 4a76209de52146bf8440fddcdd00b284. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:41:45.534416 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:41:45.536682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:41:45.581031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-04db2278-0cdd-432b-8e5c-997624d5ea27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495013 Aug 01 07:41:45.581593 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 292/599] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:41:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:41:45.592252 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a4472034-76c0-4991-a187-a6378bef533a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:45.592944 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a4472034-76c0-4991-a187-a6378bef533a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:45.648007 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a4472034-76c0-4991-a187-a6378bef533a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:45.654575 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a4472034-76c0-4991-a187-a6378bef533a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1218 microversion: 2.1 time: 0.066183 Aug 01 07:41:45.655166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 308/600] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:45 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:46.381258 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1ff2f912-98a9-4751-ac82-a2a28590aaaa tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:46.383617 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1ff2f912-98a9-4751-ac82-a2a28590aaaa tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:46.394193 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1ff2f912-98a9-4751-ac82-a2a28590aaaa tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:46.394926 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1ff2f912-98a9-4751-ac82-a2a28590aaaa tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:46.396350 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1ff2f912-98a9-4751-ac82-a2a28590aaaa tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:46.396524 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1ff2f912-98a9-4751-ac82-a2a28590aaaa tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:46.429285 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1ff2f912-98a9-4751-ac82-a2a28590aaaa tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052676 Aug 01 07:41:46.429829 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 293/601] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 1 07:41:46 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:41:46.675500 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3e3b1a4f-c1b8-48e1-97ac-b61222519eb8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:46.676102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3e3b1a4f-c1b8-48e1-97ac-b61222519eb8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:46.682947 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3e3b1a4f-c1b8-48e1-97ac-b61222519eb8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:46.683427 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3e3b1a4f-c1b8-48e1-97ac-b61222519eb8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:46.684173 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3e3b1a4f-c1b8-48e1-97ac-b61222519eb8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:46.684601 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3e3b1a4f-c1b8-48e1-97ac-b61222519eb8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:46.749669 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3e3b1a4f-c1b8-48e1-97ac-b61222519eb8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:46.758026 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3e3b1a4f-c1b8-48e1-97ac-b61222519eb8 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1214 microversion: 2.1 time: 0.086349 Aug 01 07:41:46.758584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 309/602] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:46 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:47.280834 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c2827aed-b5a7-44bd-b6f4-b5d3963f3fb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:47.282995 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c2827aed-b5a7-44bd-b6f4-b5d3963f3fb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:47.289566 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c2827aed-b5a7-44bd-b6f4-b5d3963f3fb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:47.290017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c2827aed-b5a7-44bd-b6f4-b5d3963f3fb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:47.290785 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c2827aed-b5a7-44bd-b6f4-b5d3963f3fb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:47.291305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c2827aed-b5a7-44bd-b6f4-b5d3963f3fb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:47.314120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-c2827aed-b5a7-44bd-b6f4-b5d3963f3fb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lazy-loading 'flavor' on Instance uuid 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:41:47.441987 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-092cfe4a-6982-47c3-af1a-45f9413d2751 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:47.444432 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-092cfe4a-6982-47c3-af1a-45f9413d2751 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:47.457936 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-092cfe4a-6982-47c3-af1a-45f9413d2751 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:47.458339 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-092cfe4a-6982-47c3-af1a-45f9413d2751 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:47.458963 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c2827aed-b5a7-44bd-b6f4-b5d3963f3fb1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/action" status: 200 len: 32 microversion: 2.1 time: 0.181941 Aug 01 07:41:47.459149 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-092cfe4a-6982-47c3-af1a-45f9413d2751 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:47.459744 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 294/603] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:41:47 2022] POST /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 07:41:47.460924 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-092cfe4a-6982-47c3-af1a-45f9413d2751 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:47.472571 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1f38551c-7d36-4b60-83d0-183ef59baf1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:47.473746 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1f38551c-7d36-4b60-83d0-183ef59baf1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:47.483967 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1f38551c-7d36-4b60-83d0-183ef59baf1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:47.485001 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1f38551c-7d36-4b60-83d0-183ef59baf1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:47.485965 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1f38551c-7d36-4b60-83d0-183ef59baf1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:47.487462 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1f38551c-7d36-4b60-83d0-183ef59baf1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:47.513798 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-092cfe4a-6982-47c3-af1a-45f9413d2751 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075977 Aug 01 07:41:47.520274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 310/604] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 1 07:41:47 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:41:47.780856 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b1f163f3-90f8-4307-8265-e7a72fe9ce27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:47.781599 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b1f163f3-90f8-4307-8265-e7a72fe9ce27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:47.788427 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1f163f3-90f8-4307-8265-e7a72fe9ce27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:47.788878 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1f163f3-90f8-4307-8265-e7a72fe9ce27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:47.790193 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1f163f3-90f8-4307-8265-e7a72fe9ce27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:47.790777 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b1f163f3-90f8-4307-8265-e7a72fe9ce27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:47.796951 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1f38551c-7d36-4b60-83d0-183ef59baf1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:47.806382 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1f38551c-7d36-4b60-83d0-183ef59baf1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.340720 Aug 01 07:41:47.807043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 295/605] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:47 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:47.859241 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b1f163f3-90f8-4307-8265-e7a72fe9ce27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:47.868353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b1f163f3-90f8-4307-8265-e7a72fe9ce27 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1276 microversion: 2.1 time: 0.092087 Aug 01 07:41:47.868938 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 311/606] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:47 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:48.527031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cb03ee08-ab4c-4c39-8a23-bbbee444ef12 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:48.529510 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-cb03ee08-ab4c-4c39-8a23-bbbee444ef12 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:48.537478 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb03ee08-ab4c-4c39-8a23-bbbee444ef12 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:48.537852 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb03ee08-ab4c-4c39-8a23-bbbee444ef12 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:48.538804 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb03ee08-ab4c-4c39-8a23-bbbee444ef12 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:48.539357 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cb03ee08-ab4c-4c39-8a23-bbbee444ef12 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:48.570934 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-cb03ee08-ab4c-4c39-8a23-bbbee444ef12 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047887 Aug 01 07:41:48.571539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 296/607] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 1 07:41:48 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:48.635842 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-107ebdb2-51be-430c-a0c3-a0ba22e4f1d8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:48.636429 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-107ebdb2-51be-430c-a0c3-a0ba22e4f1d8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:48.643725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-107ebdb2-51be-430c-a0c3-a0ba22e4f1d8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:48.644134 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-107ebdb2-51be-430c-a0c3-a0ba22e4f1d8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:48.644974 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-107ebdb2-51be-430c-a0c3-a0ba22e4f1d8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:48.645484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-107ebdb2-51be-430c-a0c3-a0ba22e4f1d8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:48.671517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-107ebdb2-51be-430c-a0c3-a0ba22e4f1d8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:41:48.768215 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-107ebdb2-51be-430c-a0c3-a0ba22e4f1d8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 204 len: 0 microversion: 2.20 time: 0.135307 Aug 01 07:41:48.769562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 312/608] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Aug 1 07:41:48 2022] DELETE /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 01 07:41:48.777895 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8d1ba9c2-8e1d-40f5-a68e-516b2ad46da1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:48.778762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8d1ba9c2-8e1d-40f5-a68e-516b2ad46da1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:48.785044 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8d1ba9c2-8e1d-40f5-a68e-516b2ad46da1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:48.785629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8d1ba9c2-8e1d-40f5-a68e-516b2ad46da1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:48.786523 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8d1ba9c2-8e1d-40f5-a68e-516b2ad46da1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:48.787297 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8d1ba9c2-8e1d-40f5-a68e-516b2ad46da1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:48.829847 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1b143e55-3e0c-4dbe-8ae6-a4caee708b9c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:48.830854 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1b143e55-3e0c-4dbe-8ae6-a4caee708b9c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:48.837564 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b143e55-3e0c-4dbe-8ae6-a4caee708b9c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:48.838009 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b143e55-3e0c-4dbe-8ae6-a4caee708b9c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:48.838767 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b143e55-3e0c-4dbe-8ae6-a4caee708b9c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:48.839228 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b143e55-3e0c-4dbe-8ae6-a4caee708b9c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:48.922725 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8d1ba9c2-8e1d-40f5-a68e-516b2ad46da1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:48.930732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8d1ba9c2-8e1d-40f5-a68e-516b2ad46da1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:48.932281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8d1ba9c2-8e1d-40f5-a68e-516b2ad46da1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:48.933440 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8d1ba9c2-8e1d-40f5-a68e-516b2ad46da1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.159885 Aug 01 07:41:48.934001 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 297/609] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:41:48 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:41:48.938288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-27360ab0-4780-4c60-b60d-30b3c8e0cad5 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:48.939093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-27360ab0-4780-4c60-b60d-30b3c8e0cad5 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:48.945923 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-27360ab0-4780-4c60-b60d-30b3c8e0cad5 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:48.946379 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-27360ab0-4780-4c60-b60d-30b3c8e0cad5 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:48.947179 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-27360ab0-4780-4c60-b60d-30b3c8e0cad5 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:48.947623 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-27360ab0-4780-4c60-b60d-30b3c8e0cad5 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:48.977303 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1b143e55-3e0c-4dbe-8ae6-a4caee708b9c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:48.985553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1b143e55-3e0c-4dbe-8ae6-a4caee708b9c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.160060 Aug 01 07:41:48.986274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 313/610] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:48 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:49.076967 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-27360ab0-4780-4c60-b60d-30b3c8e0cad5 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:49.084920 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-27360ab0-4780-4c60-b60d-30b3c8e0cad5 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1318 microversion: 2.1 time: 0.149967 Aug 01 07:41:49.085484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 298/611] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:48 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:49.957254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-68423b0a-50c6-4d67-bd5f-3439cf83b295 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:49.957857 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-68423b0a-50c6-4d67-bd5f-3439cf83b295 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:49.960350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:49.965989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68423b0a-50c6-4d67-bd5f-3439cf83b295 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:49.966333 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68423b0a-50c6-4d67-bd5f-3439cf83b295 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:49.967128 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68423b0a-50c6-4d67-bd5f-3439cf83b295 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:49.967569 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-68423b0a-50c6-4d67-bd5f-3439cf83b295 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:50.007911 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e5666b8e-5533-4108-a5f4-d65af9c74820 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:50.008540 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e5666b8e-5533-4108-a5f4-d65af9c74820 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:50.015148 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e5666b8e-5533-4108-a5f4-d65af9c74820 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:50.015611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e5666b8e-5533-4108-a5f4-d65af9c74820 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:50.016390 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e5666b8e-5533-4108-a5f4-d65af9c74820 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:50.016836 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e5666b8e-5533-4108-a5f4-d65af9c74820 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:50.103950 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-68423b0a-50c6-4d67-bd5f-3439cf83b295 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:50.113668 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-68423b0a-50c6-4d67-bd5f-3439cf83b295 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:50.115175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-68423b0a-50c6-4d67-bd5f-3439cf83b295 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:50.116324 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-68423b0a-50c6-4d67-bd5f-3439cf83b295 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.163030 Aug 01 07:41:50.117192 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 314/612] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:41:49 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:41:50.121538 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5de43aa3-14f6-4c0c-aa57-a73d351f1399 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:50.122125 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5de43aa3-14f6-4c0c-aa57-a73d351f1399 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:50.129624 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5de43aa3-14f6-4c0c-aa57-a73d351f1399 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:50.130072 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5de43aa3-14f6-4c0c-aa57-a73d351f1399 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:50.131042 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5de43aa3-14f6-4c0c-aa57-a73d351f1399 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:50.131675 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5de43aa3-14f6-4c0c-aa57-a73d351f1399 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:50.149752 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:50.152922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e5666b8e-5533-4108-a5f4-d65af9c74820 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:50.161694 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e5666b8e-5533-4108-a5f4-d65af9c74820 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.157537 Aug 01 07:41:50.162283 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 299/613] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:50 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:50.264839 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5de43aa3-14f6-4c0c-aa57-a73d351f1399 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:50.272755 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5de43aa3-14f6-4c0c-aa57-a73d351f1399 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1318 microversion: 2.1 time: 0.154612 Aug 01 07:41:50.273308 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 315/614] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:50 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:51.130438 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-76e97329-208d-4338-a9c2-3f49d5d0acd5 req-732ca05d-f3e2-4bfc-8173-2e373b06e774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abaea826-3743-471a-94d3-bc4c726b2ccb", "tag": "90e22fc0-ea0f-4c8c-81e7-22368b17e626"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:51.141398 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-de431edc-7812-4b14-9ab4-bafcee187fad tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:51.141994 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-de431edc-7812-4b14-9ab4-bafcee187fad tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:51.144559 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:51.154236 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de431edc-7812-4b14-9ab4-bafcee187fad tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:51.154693 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de431edc-7812-4b14-9ab4-bafcee187fad tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:51.155092 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-76e97329-208d-4338-a9c2-3f49d5d0acd5 req-732ca05d-f3e2-4bfc-8173-2e373b06e774 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:51.155496 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de431edc-7812-4b14-9ab4-bafcee187fad tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:51.155745 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-76e97329-208d-4338-a9c2-3f49d5d0acd5 req-732ca05d-f3e2-4bfc-8173-2e373b06e774 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:51.155936 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-de431edc-7812-4b14-9ab4-bafcee187fad tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:51.167453 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-76e97329-208d-4338-a9c2-3f49d5d0acd5 req-732ca05d-f3e2-4bfc-8173-2e373b06e774 service nova] Creating event network-changed:90e22fc0-ea0f-4c8c-81e7-22368b17e626 for instance abaea826-3743-471a-94d3-bc4c726b2ccb on hv-cinder-73306 Aug 01 07:41:51.172757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-76e97329-208d-4338-a9c2-3f49d5d0acd5 req-732ca05d-f3e2-4bfc-8173-2e373b06e774 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046934 Aug 01 07:41:51.173897 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 300/615] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:41:51.184124 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-986d7610-0d3f-4295-b71b-43447be3806c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:51.184940 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-986d7610-0d3f-4295-b71b-43447be3806c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:51.192171 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-986d7610-0d3f-4295-b71b-43447be3806c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:51.192699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-986d7610-0d3f-4295-b71b-43447be3806c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:51.193788 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-986d7610-0d3f-4295-b71b-43447be3806c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:51.194296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-986d7610-0d3f-4295-b71b-43447be3806c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:51.302981 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-de431edc-7812-4b14-9ab4-bafcee187fad tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:51.314877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-de431edc-7812-4b14-9ab4-bafcee187fad tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:51.315625 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-de431edc-7812-4b14-9ab4-bafcee187fad tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:51.316934 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-de431edc-7812-4b14-9ab4-bafcee187fad tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1723 microversion: 2.20 time: 0.180509 Aug 01 07:41:51.325099 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 316/616] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:41:51 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:41:51.330600 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f592b31b-b99d-42bd-bc82-36c022bd0338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:51.331631 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f592b31b-b99d-42bd-bc82-36c022bd0338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:51.338012 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f592b31b-b99d-42bd-bc82-36c022bd0338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:51.338657 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f592b31b-b99d-42bd-bc82-36c022bd0338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:51.339637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f592b31b-b99d-42bd-bc82-36c022bd0338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:51.340320 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f592b31b-b99d-42bd-bc82-36c022bd0338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:51.475654 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f592b31b-b99d-42bd-bc82-36c022bd0338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:51.483183 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f592b31b-b99d-42bd-bc82-36c022bd0338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1318 microversion: 2.1 time: 0.156825 Aug 01 07:41:51.483749 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 317/617] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:51 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:51.604051 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-986d7610-0d3f-4295-b71b-43447be3806c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:51.612500 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-986d7610-0d3f-4295-b71b-43447be3806c tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.432421 Aug 01 07:41:51.613076 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 301/618] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:51 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:52.341827 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2f67f4da-6ba0-4725-9d22-e7f47a9b64dc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:52.342539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2f67f4da-6ba0-4725-9d22-e7f47a9b64dc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:52.349789 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f67f4da-6ba0-4725-9d22-e7f47a9b64dc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:52.350515 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f67f4da-6ba0-4725-9d22-e7f47a9b64dc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:52.351441 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f67f4da-6ba0-4725-9d22-e7f47a9b64dc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:52.352093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2f67f4da-6ba0-4725-9d22-e7f47a9b64dc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:52.430155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2f67f4da-6ba0-4725-9d22-e7f47a9b64dc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:52.438189 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2f67f4da-6ba0-4725-9d22-e7f47a9b64dc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:52.439785 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2f67f4da-6ba0-4725-9d22-e7f47a9b64dc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:52.440912 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2f67f4da-6ba0-4725-9d22-e7f47a9b64dc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1656 microversion: 2.20 time: 0.103034 Aug 01 07:41:52.451663 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 318/619] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:41:52 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1656 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:41:52.506606 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5616a312-94c9-4c74-9bca-815048fd170c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:52.507696 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5616a312-94c9-4c74-9bca-815048fd170c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:52.515187 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5616a312-94c9-4c74-9bca-815048fd170c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:52.515716 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5616a312-94c9-4c74-9bca-815048fd170c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:52.516547 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5616a312-94c9-4c74-9bca-815048fd170c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:52.517084 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5616a312-94c9-4c74-9bca-815048fd170c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:52.634156 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d4dfa6b6-a744-49cb-b1ab-83bb71d76157 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:52.635214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d4dfa6b6-a744-49cb-b1ab-83bb71d76157 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:52.641517 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d4dfa6b6-a744-49cb-b1ab-83bb71d76157 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:52.642372 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d4dfa6b6-a744-49cb-b1ab-83bb71d76157 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:52.644110 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d4dfa6b6-a744-49cb-b1ab-83bb71d76157 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:52.644798 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d4dfa6b6-a744-49cb-b1ab-83bb71d76157 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:52.662418 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5616a312-94c9-4c74-9bca-815048fd170c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:52.670552 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5616a312-94c9-4c74-9bca-815048fd170c tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1318 microversion: 2.1 time: 0.169458 Aug 01 07:41:52.671165 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 302/620] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:52 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:52.786877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d4dfa6b6-a744-49cb-b1ab-83bb71d76157 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:52.795725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d4dfa6b6-a744-49cb-b1ab-83bb71d76157 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.165551 Aug 01 07:41:52.799101 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 319/621] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:52 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:53.199749 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-c870dbd7-3bf0-442d-8497-dd9ac5e93fda req-da952989-e783-4bf9-b58d-17df9dadf8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff143cc-5a30-44be-a327-29eaacf61348", "name": "network-vif-deleted", "tag": "7b59d41d-43d0-4098-917e-f7635e0051db"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:53.210399 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-c870dbd7-3bf0-442d-8497-dd9ac5e93fda req-da952989-e783-4bf9-b58d-17df9dadf8ee service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:53.210857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-c870dbd7-3bf0-442d-8497-dd9ac5e93fda req-da952989-e783-4bf9-b58d-17df9dadf8ee service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:53.222463 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-c870dbd7-3bf0-442d-8497-dd9ac5e93fda req-da952989-e783-4bf9-b58d-17df9dadf8ee service nova] Creating event network-vif-deleted:7b59d41d-43d0-4098-917e-f7635e0051db for instance 8ff143cc-5a30-44be-a327-29eaacf61348 on hv-cinder-73306 Aug 01 07:41:53.240173 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-c870dbd7-3bf0-442d-8497-dd9ac5e93fda req-da952989-e783-4bf9-b58d-17df9dadf8ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043858 Aug 01 07:41:53.240935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 303/622] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:53.464312 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4d0adacc-16f7-4ceb-a9ad-e4e7fb9b8ac4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:53.464984 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4d0adacc-16f7-4ceb-a9ad-e4e7fb9b8ac4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:53.472385 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4d0adacc-16f7-4ceb-a9ad-e4e7fb9b8ac4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:53.472847 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4d0adacc-16f7-4ceb-a9ad-e4e7fb9b8ac4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:53.473614 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4d0adacc-16f7-4ceb-a9ad-e4e7fb9b8ac4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:53.474054 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4d0adacc-16f7-4ceb-a9ad-e4e7fb9b8ac4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:53.535993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4d0adacc-16f7-4ceb-a9ad-e4e7fb9b8ac4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:53.544039 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4d0adacc-16f7-4ceb-a9ad-e4e7fb9b8ac4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:53.545557 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4d0adacc-16f7-4ceb-a9ad-e4e7fb9b8ac4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:53.546691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4d0adacc-16f7-4ceb-a9ad-e4e7fb9b8ac4 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1367 microversion: 2.20 time: 0.086313 Aug 01 07:41:53.547276 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 320/623] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:41:53 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:41:53.692497 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b783b35f-774b-48fa-943d-7b7bfae887a1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:53.693829 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b783b35f-774b-48fa-943d-7b7bfae887a1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:53.700209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b783b35f-774b-48fa-943d-7b7bfae887a1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:53.700663 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b783b35f-774b-48fa-943d-7b7bfae887a1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:53.701527 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b783b35f-774b-48fa-943d-7b7bfae887a1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:53.701970 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b783b35f-774b-48fa-943d-7b7bfae887a1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:53.817335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4f560a17-4218-4d91-924b-b66e4f4710be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:53.818253 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4f560a17-4218-4d91-924b-b66e4f4710be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:53.824466 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4f560a17-4218-4d91-924b-b66e4f4710be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:53.825027 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4f560a17-4218-4d91-924b-b66e4f4710be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:53.825895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4f560a17-4218-4d91-924b-b66e4f4710be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:53.826583 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4f560a17-4218-4d91-924b-b66e4f4710be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:53.847960 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b783b35f-774b-48fa-943d-7b7bfae887a1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:53.852007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:53.857627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b783b35f-774b-48fa-943d-7b7bfae887a1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1318 microversion: 2.1 time: 0.169762 Aug 01 07:41:53.858289 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 304/624] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:53 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:53.975399 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4f560a17-4218-4d91-924b-b66e4f4710be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:53.983956 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4f560a17-4218-4d91-924b-b66e4f4710be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.170662 Aug 01 07:41:53.984544 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 321/625] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:53 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:54.572155 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:54.573110 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:54.592202 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:54.592868 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:54.594893 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:54.602891 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:54.678303 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:54.680176 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:54.680961 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lazy-loading 'fault' on Instance uuid 8ff143cc-5a30-44be-a327-29eaacf61348 {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:41:54.741220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8aa00de0-1ee7-47c9-986e-ea467c87b4cf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:54.741838 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8aa00de0-1ee7-47c9-986e-ea467c87b4cf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:54.753345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8aa00de0-1ee7-47c9-986e-ea467c87b4cf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:54.756373 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8aa00de0-1ee7-47c9-986e-ea467c87b4cf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:54.757427 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8aa00de0-1ee7-47c9-986e-ea467c87b4cf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:54.758044 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8aa00de0-1ee7-47c9-986e-ea467c87b4cf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:54.816028 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:54.827931 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:54.840399 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:54.842904 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-062232d3-8004-4f81-a900-c2848f9a63f1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 200 len: 1372 microversion: 2.20 time: 0.277436 Aug 01 07:41:54.846717 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 305/626] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:41:54 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 1372 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:41:54.879296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0a237943-3248-4350-9383-944b102f5cdf tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:54.880320 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0a237943-3248-4350-9383-944b102f5cdf tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:54.886658 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a237943-3248-4350-9383-944b102f5cdf tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:54.887000 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a237943-3248-4350-9383-944b102f5cdf tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:54.887984 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a237943-3248-4350-9383-944b102f5cdf tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:54.888579 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a237943-3248-4350-9383-944b102f5cdf tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:54.923104 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8aa00de0-1ee7-47c9-986e-ea467c87b4cf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:54.932035 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8aa00de0-1ee7-47c9-986e-ea467c87b4cf tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1595 microversion: 2.1 time: 0.194578 Aug 01 07:41:54.932543 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 322/627] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:54 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1595 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:55.009902 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-efb509d8-3bbe-4502-ad3c-0a23d6c3bbd1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:55.010681 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-efb509d8-3bbe-4502-ad3c-0a23d6c3bbd1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:55.017316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-efb509d8-3bbe-4502-ad3c-0a23d6c3bbd1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:55.017988 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-efb509d8-3bbe-4502-ad3c-0a23d6c3bbd1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:55.018972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-efb509d8-3bbe-4502-ad3c-0a23d6c3bbd1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:55.019638 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-efb509d8-3bbe-4502-ad3c-0a23d6c3bbd1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:55.034985 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0a237943-3248-4350-9383-944b102f5cdf tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:55.043408 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0a237943-3248-4350-9383-944b102f5cdf tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1318 microversion: 2.1 time: 0.169179 Aug 01 07:41:55.045083 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 306/628] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:54 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:55.180083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-efb509d8-3bbe-4502-ad3c-0a23d6c3bbd1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:55.189465 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-efb509d8-3bbe-4502-ad3c-0a23d6c3bbd1 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.183374 Aug 01 07:41:55.196093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 323/629] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:55 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:55.870296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f264e9ee-d96e-420a-ade0-9a919dd4175b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:55.870969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f264e9ee-d96e-420a-ade0-9a919dd4175b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:55.872925 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:55.873562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=6 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:55.881921 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f264e9ee-d96e-420a-ade0-9a919dd4175b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:55.882403 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f264e9ee-d96e-420a-ade0-9a919dd4175b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:55.883199 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f264e9ee-d96e-420a-ade0-9a919dd4175b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:55.883640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f264e9ee-d96e-420a-ade0-9a919dd4175b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:55.898528 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-f264e9ee-d96e-420a-ade0-9a919dd4175b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] HTTP exception thrown: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f264e9ee-d96e-420a-ade0-9a919dd4175b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Request method failure captured: Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 HTTP/1.1 Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54K23XEuD4dhD-3BUUnDIlZvhK2AlVEUHMzuBt1F2oosUBsTXdfAJ0ki1HmOCwZG11eZTEoiD7KAeLf6MmZZ8hcf6j_DPCvAcWKOjhp1PPO5fzBDbI3fnZBJ_pfSA2RJGmd_dl0uTGDESFoVLsvXMOwZYeqHiuOg9cSjH31siSo7cSQ Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:41:55.900227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a2b83a4dad243e79144db87357d1897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1e02f414ef2a4990bd1492a63d074319 Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:41:55.901837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '8ff143cc-5a30-44be-a327-29eaacf61348'} Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:41:55.902841 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:41:55.904426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:41:55.906553 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f264e9ee-d96e-420a-ade0-9a919dd4175b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Returning 404 to user: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:41:55.906553 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f264e9ee-d96e-420a-ade0-9a919dd4175b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 404 len: 111 microversion: 2.20 time: 0.035254 Aug 01 07:41:55.906553 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 307/630] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:41:55 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 07:41:55.910613 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5969516c-755d-42b6-bfa9-55ca882d1d08 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '.version_select at 0x7fd0188cd790>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:55.915641 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:41:55.938615 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5969516c-755d-42b6-bfa9-55ca882d1d08 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027807052" status: 204 len: 0 microversion: 2.20 time: 0.031745 Aug 01 07:41:55.939895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 324/631] 10.222.0.40 () {60 vars in 1262 bytes} [Mon Aug 1 07:41:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027807052 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 07:41:56.066706 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2d94bb57-f7a0-44bb-b728-82ef022fea8e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:56.067355 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2d94bb57-f7a0-44bb-b728-82ef022fea8e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:56.073862 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d94bb57-f7a0-44bb-b728-82ef022fea8e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:56.074496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d94bb57-f7a0-44bb-b728-82ef022fea8e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:56.075487 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d94bb57-f7a0-44bb-b728-82ef022fea8e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:56.076087 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d94bb57-f7a0-44bb-b728-82ef022fea8e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:56.214347 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-46815686-8af8-44f9-b464-9d29df88b265 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:56.215639 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-46815686-8af8-44f9-b464-9d29df88b265 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:56.225245 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-46815686-8af8-44f9-b464-9d29df88b265 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:56.226184 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-46815686-8af8-44f9-b464-9d29df88b265 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:56.227387 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-46815686-8af8-44f9-b464-9d29df88b265 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:56.228045 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-46815686-8af8-44f9-b464-9d29df88b265 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:56.320093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2d94bb57-f7a0-44bb-b728-82ef022fea8e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:56.328128 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2d94bb57-f7a0-44bb-b728-82ef022fea8e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1318 microversion: 2.1 time: 0.266219 Aug 01 07:41:56.328927 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 308/632] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:56 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:56.452839 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-46815686-8af8-44f9-b464-9d29df88b265 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:56.462291 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-46815686-8af8-44f9-b464-9d29df88b265 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.254052 Aug 01 07:41:56.463146 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 325/633] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:56 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:56.556875 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-044af525-a2c1-4358-99f7-af36aef51760 req-95e4f8e5-3818-401d-8b2c-14ac3ee5d3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abaea826-3743-471a-94d3-bc4c726b2ccb", "name": "network-vif-plugged", "status": "completed", "tag": "90e22fc0-ea0f-4c8c-81e7-22368b17e626"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:56.569057 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-044af525-a2c1-4358-99f7-af36aef51760 req-95e4f8e5-3818-401d-8b2c-14ac3ee5d3d6 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:56.569758 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-044af525-a2c1-4358-99f7-af36aef51760 req-95e4f8e5-3818-401d-8b2c-14ac3ee5d3d6 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:56.590582 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-044af525-a2c1-4358-99f7-af36aef51760 req-95e4f8e5-3818-401d-8b2c-14ac3ee5d3d6 service nova] Creating event network-vif-plugged:90e22fc0-ea0f-4c8c-81e7-22368b17e626 for instance abaea826-3743-471a-94d3-bc4c726b2ccb on hv-cinder-73306 Aug 01 07:41:56.597682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-044af525-a2c1-4358-99f7-af36aef51760 req-95e4f8e5-3818-401d-8b2c-14ac3ee5d3d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044611 Aug 01 07:41:56.598923 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 309/634] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:56.847928 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-06aeae46-c937-4bf9-a379-66895e5cba48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Action: 'create', calling method: .version_select at 0x7fd0189754c0>, body: {"keypair": {"name": "tempest-keypair-2049746085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57aMIxFHc/ayM/b4oMx8e8NlT9AFEXB9b7tQAaAfc30Fyk24wt5QnWOOMwsr345V0opuWbRhTblr6uLAVbe9Kx0q+iMVGxE1u851eIW6SNzH1xUc4BIihYMiUg3rahJw=="}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:56.864364 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-06aeae46-c937-4bf9-a379-66895e5cba48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Getting quotas for project 4a2b83a4dad243e79144db87357d1897. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:41:56.868266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-06aeae46-c937-4bf9-a379-66895e5cba48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Getting quotas for user 1e02f414ef2a4990bd1492a63d074319 and project 4a2b83a4dad243e79144db87357d1897. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:41:56.891394 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-06aeae46-c937-4bf9-a379-66895e5cba48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048970 Aug 01 07:41:56.892050 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 326/635] 10.222.0.40 () {62 vars in 1200 bytes} [Mon Aug 1 07:41:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 07:41:57.087623 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-10ddb4b4-ce1e-48ce-856f-95a5e459353f req-ce85da28-0232-40d3-9c96-01c9afa1797a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587f64fe-aa07-43ef-942a-883dfa6b585c", "tag": "2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:57.100879 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-10ddb4b4-ce1e-48ce-856f-95a5e459353f req-ce85da28-0232-40d3-9c96-01c9afa1797a service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:57.101912 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-10ddb4b4-ce1e-48ce-856f-95a5e459353f req-ce85da28-0232-40d3-9c96-01c9afa1797a service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:57.116780 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-10ddb4b4-ce1e-48ce-856f-95a5e459353f req-ce85da28-0232-40d3-9c96-01c9afa1797a service nova] Creating event network-changed:2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f for instance 587f64fe-aa07-43ef-942a-883dfa6b585c on hv-cinder-73306 Aug 01 07:41:57.121723 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-10ddb4b4-ce1e-48ce-856f-95a5e459353f req-ce85da28-0232-40d3-9c96-01c9afa1797a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038897 Aug 01 07:41:57.122544 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 310/636] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:57.351381 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bcd3b311-96fc-4287-910c-5ab85b9c1f1b tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:57.352870 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-bcd3b311-96fc-4287-910c-5ab85b9c1f1b tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:57.361376 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bcd3b311-96fc-4287-910c-5ab85b9c1f1b tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:57.362077 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bcd3b311-96fc-4287-910c-5ab85b9c1f1b tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:57.363128 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bcd3b311-96fc-4287-910c-5ab85b9c1f1b tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:57.363802 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bcd3b311-96fc-4287-910c-5ab85b9c1f1b tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:57.488458 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-bd597667-3507-4754-8fdb-4efd531e078d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:57.489256 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-bd597667-3507-4754-8fdb-4efd531e078d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:57.502917 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bd597667-3507-4754-8fdb-4efd531e078d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:57.503401 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bd597667-3507-4754-8fdb-4efd531e078d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:57.504192 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bd597667-3507-4754-8fdb-4efd531e078d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:57.504630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bd597667-3507-4754-8fdb-4efd531e078d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:57.647368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bcd3b311-96fc-4287-910c-5ab85b9c1f1b tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:57.659034 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-bcd3b311-96fc-4287-910c-5ab85b9c1f1b tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1318 microversion: 2.1 time: 0.311656 Aug 01 07:41:57.660743 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 327/637] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:57 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:57.731512 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-bd597667-3507-4754-8fdb-4efd531e078d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:57.741118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-bd597667-3507-4754-8fdb-4efd531e078d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.258133 Aug 01 07:41:57.742063 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 311/638] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:57 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:58.532659 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b57be722-c207-42b9-ba0d-a3c80ae84def tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1502450041"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:58.533273 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b57be722-c207-42b9-ba0d-a3c80ae84def tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:58.540154 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b57be722-c207-42b9-ba0d-a3c80ae84def tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:58.540663 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b57be722-c207-42b9-ba0d-a3c80ae84def tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:58.541581 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b57be722-c207-42b9-ba0d-a3c80ae84def tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:58.542068 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b57be722-c207-42b9-ba0d-a3c80ae84def tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:58.680910 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-615d7e2f-629c-4388-89a4-7fc56f702953 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:58.681831 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-615d7e2f-629c-4388-89a4-7fc56f702953 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:58.689604 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-615d7e2f-629c-4388-89a4-7fc56f702953 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:58.690167 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-615d7e2f-629c-4388-89a4-7fc56f702953 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:58.691212 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-615d7e2f-629c-4388-89a4-7fc56f702953 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:58.691764 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-615d7e2f-629c-4388-89a4-7fc56f702953 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:58.740518 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.network.security_group_api [None req-b57be722-c207-42b9-ba0d-a3c80ae84def tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Adding security group 658ab7c7-37de-4fe8-a7d6-e7a76339cfe0 to port 2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f Aug 01 07:41:58.921015 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-615d7e2f-629c-4388-89a4-7fc56f702953 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:58.930419 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-615d7e2f-629c-4388-89a4-7fc56f702953 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1507 microversion: 2.1 time: 0.253485 Aug 01 07:41:58.931463 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 312/639] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:58 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:41:58.937691 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-85da8067-8724-4715-a6d0-66a70d81eede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:58.938562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-85da8067-8724-4715-a6d0-66a70d81eede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:58.948160 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-85da8067-8724-4715-a6d0-66a70d81eede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:58.948909 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-85da8067-8724-4715-a6d0-66a70d81eede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:58.950317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-85da8067-8724-4715-a6d0-66a70d81eede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:58.954294 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-85da8067-8724-4715-a6d0-66a70d81eede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:59.093127 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-85da8067-8724-4715-a6d0-66a70d81eede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:59.102646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-85da8067-8724-4715-a6d0-66a70d81eede tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.169243 Aug 01 07:41:59.103285 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 313/640] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:58 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:59.112651 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1487791533", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0dc32e8a-ab07-41b5-814a-a9a38a1db465"}], "security_groups": [{"name": "tempest-securitygroup--1122527170"}], "key_name": "tempest-keypair-2049746085", "user_data": "}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:59.139306 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b57be722-c207-42b9-ba0d-a3c80ae84def tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "POST /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/action" status: 202 len: 0 microversion: 2.1 time: 0.612281 Aug 01 07:41:59.140500 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 328/641] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:41:58 2022] POST /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:41:59.148973 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c68f371c-51ec-4831-a903-f9c39573bf5a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c80e4935-05a9-4aa8-8c42-ac070e2d8122", "device": "/dev/sdb"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:59.152449 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c68f371c-51ec-4831-a903-f9c39573bf5a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:59.160577 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c68f371c-51ec-4831-a903-f9c39573bf5a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:59.161301 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c68f371c-51ec-4831-a903-f9c39573bf5a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:59.163175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c68f371c-51ec-4831-a903-f9c39573bf5a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:59.165184 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c68f371c-51ec-4831-a903-f9c39573bf5a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:59.255378 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] validate_networks() for [('0dc32e8a-ab07-41b5-814a-a9a38a1db465', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:41:59.439785 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c68f371c-51ec-4831-a903-f9c39573bf5a tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "POST /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297532 Aug 01 07:41:59.467258 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 329/642] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:41:59 2022] POST /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:59.475849 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-14fa6d6f-ec83-4ace-8fb5-b7a28b919d90 req-ef18402b-ee38-442f-8310-9bce3a9da574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587f64fe-aa07-43ef-942a-883dfa6b585c", "tag": "2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:41:59.502675 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-14fa6d6f-ec83-4ace-8fb5-b7a28b919d90 req-ef18402b-ee38-442f-8310-9bce3a9da574 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:59.504292 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-14fa6d6f-ec83-4ace-8fb5-b7a28b919d90 req-ef18402b-ee38-442f-8310-9bce3a9da574 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:59.542504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-14fa6d6f-ec83-4ace-8fb5-b7a28b919d90 req-ef18402b-ee38-442f-8310-9bce3a9da574 service nova] Creating event network-changed:2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f for instance 587f64fe-aa07-43ef-942a-883dfa6b585c on hv-cinder-73306 Aug 01 07:41:59.549941 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-14fa6d6f-ec83-4ace-8fb5-b7a28b919d90 req-ef18402b-ee38-442f-8310-9bce3a9da574 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078586 Aug 01 07:41:59.550553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 330/643] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:41:59.561164 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-aa73860d-669f-4bd0-9042-ad35d450f582 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:59.562047 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-aa73860d-669f-4bd0-9042-ad35d450f582 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:41:59.572378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa73860d-669f-4bd0-9042-ad35d450f582 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:59.574195 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa73860d-669f-4bd0-9042-ad35d450f582 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:59.575647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa73860d-669f-4bd0-9042-ad35d450f582 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:59.576259 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa73860d-669f-4bd0-9042-ad35d450f582 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:59.775781 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-aa73860d-669f-4bd0-9042-ad35d450f582 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:41:59.787433 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-aa73860d-669f-4bd0-9042-ad35d450f582 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1761 microversion: 2.1 time: 0.229893 Aug 01 07:41:59.788022 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 331/644] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:41:59 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1761 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:41:59.827502 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:41:59.828014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:41:59.828380 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:41:59.828784 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:41:59.829421 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:41:59.838584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:59.839038 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:59.839966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:41:59.840408 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:41:59.858363 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Getting quotas for project 4a2b83a4dad243e79144db87357d1897. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:41:59.863400 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Getting quotas for user 1e02f414ef2a4990bd1492a63d074319 and project 4a2b83a4dad243e79144db87357d1897. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:41:59.875264 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:41:59.878134 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:41:59.925235 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d8459e77-1ce9-42a4-915c-b6cd6f3f0151 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.820879 Aug 01 07:41:59.931584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 314/645] 10.222.0.40 () {62 vars in 1188 bytes} [Mon Aug 1 07:41:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 07:41:59.937518 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6b1ad7e3-c8e5-4449-b07a-1056dfb245e5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:41:59.938605 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6b1ad7e3-c8e5-4449-b07a-1056dfb245e5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:00.124842 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ef69aad3-4d6e-42a4-98f0-b9189541286b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:00.125459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ef69aad3-4d6e-42a4-98f0-b9189541286b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:00.146643 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ef69aad3-4d6e-42a4-98f0-b9189541286b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:00.147122 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ef69aad3-4d6e-42a4-98f0-b9189541286b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:00.147962 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ef69aad3-4d6e-42a4-98f0-b9189541286b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:00.148404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ef69aad3-4d6e-42a4-98f0-b9189541286b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:00.231884 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6b1ad7e3-c8e5-4449-b07a-1056dfb245e5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:00.241096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6b1ad7e3-c8e5-4449-b07a-1056dfb245e5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:00.242925 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6b1ad7e3-c8e5-4449-b07a-1056dfb245e5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:00.244880 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6b1ad7e3-c8e5-4449-b07a-1056dfb245e5 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1282 microversion: 2.20 time: 0.311601 Aug 01 07:42:00.256180 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 332/646] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:41:59 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1282 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:00.385300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ef69aad3-4d6e-42a4-98f0-b9189541286b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:00.395105 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ef69aad3-4d6e-42a4-98f0-b9189541286b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.274049 Aug 01 07:42:00.395636 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 315/647] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:00 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:01.270064 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d331d108-4447-44f4-806b-573e07c2c0e9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:01.270611 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d331d108-4447-44f4-806b-573e07c2c0e9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:01.277813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d331d108-4447-44f4-806b-573e07c2c0e9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:01.278264 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d331d108-4447-44f4-806b-573e07c2c0e9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:01.279025 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d331d108-4447-44f4-806b-573e07c2c0e9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:01.279518 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d331d108-4447-44f4-806b-573e07c2c0e9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:01.346184 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d331d108-4447-44f4-806b-573e07c2c0e9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:01.354486 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d331d108-4447-44f4-806b-573e07c2c0e9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:01.356001 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d331d108-4447-44f4-806b-573e07c2c0e9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:01.357103 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d331d108-4447-44f4-806b-573e07c2c0e9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1340 microversion: 2.20 time: 0.092291 Aug 01 07:42:01.357658 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 333/648] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:01 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:01.417085 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d84c2c74-c74e-45b9-84c2-f65a8f4838b9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:01.418433 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d84c2c74-c74e-45b9-84c2-f65a8f4838b9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:01.425873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d84c2c74-c74e-45b9-84c2-f65a8f4838b9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:01.426327 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d84c2c74-c74e-45b9-84c2-f65a8f4838b9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:01.427160 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d84c2c74-c74e-45b9-84c2-f65a8f4838b9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:01.427577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d84c2c74-c74e-45b9-84c2-f65a8f4838b9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:01.626674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d84c2c74-c74e-45b9-84c2-f65a8f4838b9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:01.635757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d84c2c74-c74e-45b9-84c2-f65a8f4838b9 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.222942 Aug 01 07:42:01.636340 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 316/649] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:01 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:02.380207 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a1d89c94-8784-4e46-8e48-8846ab119e63 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:02.380853 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a1d89c94-8784-4e46-8e48-8846ab119e63 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:02.387572 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1d89c94-8784-4e46-8e48-8846ab119e63 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:02.388027 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1d89c94-8784-4e46-8e48-8846ab119e63 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:02.388792 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1d89c94-8784-4e46-8e48-8846ab119e63 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:02.389230 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a1d89c94-8784-4e46-8e48-8846ab119e63 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:02.487896 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-eafdd234-5ef0-41a0-980b-b1a1cdef5dd3 req-f137bea6-05a3-42a8-820c-d92e6d026e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f30f324-1dcf-44b9-b81d-ef96811b0a87", "tag": "23ceaa56-07cb-42cc-83de-2bfdae7aac98"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:02.508958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-eafdd234-5ef0-41a0-980b-b1a1cdef5dd3 req-f137bea6-05a3-42a8-820c-d92e6d026e85 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:02.509414 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-eafdd234-5ef0-41a0-980b-b1a1cdef5dd3 req-f137bea6-05a3-42a8-820c-d92e6d026e85 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:02.521693 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-eafdd234-5ef0-41a0-980b-b1a1cdef5dd3 req-f137bea6-05a3-42a8-820c-d92e6d026e85 service nova] Creating event network-changed:23ceaa56-07cb-42cc-83de-2bfdae7aac98 for instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 on hv-cinder-73306 Aug 01 07:42:02.527461 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-eafdd234-5ef0-41a0-980b-b1a1cdef5dd3 req-f137bea6-05a3-42a8-820c-d92e6d026e85 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043735 Aug 01 07:42:02.528524 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 317/650] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:02.548160 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a1d89c94-8784-4e46-8e48-8846ab119e63 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:02.551730 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:02.557345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a1d89c94-8784-4e46-8e48-8846ab119e63 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:02.559220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a1d89c94-8784-4e46-8e48-8846ab119e63 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:02.560280 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a1d89c94-8784-4e46-8e48-8846ab119e63 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.184489 Aug 01 07:42:02.560832 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 334/651] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:02 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:02.672525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1b3e18ac-15f9-4869-8fe4-553ba51708b3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:02.673310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1b3e18ac-15f9-4869-8fe4-553ba51708b3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:02.679792 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b3e18ac-15f9-4869-8fe4-553ba51708b3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:02.680333 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b3e18ac-15f9-4869-8fe4-553ba51708b3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:02.681186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b3e18ac-15f9-4869-8fe4-553ba51708b3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:02.681701 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b3e18ac-15f9-4869-8fe4-553ba51708b3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:03.138547 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1b3e18ac-15f9-4869-8fe4-553ba51708b3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:03.147241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1b3e18ac-15f9-4869-8fe4-553ba51708b3 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.478985 Aug 01 07:42:03.147819 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 318/652] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:02 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:03.589901 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-77dd4968-8ec8-4060-b248-467db0c843a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:03.590445 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-77dd4968-8ec8-4060-b248-467db0c843a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:03.599048 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77dd4968-8ec8-4060-b248-467db0c843a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:03.599522 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77dd4968-8ec8-4060-b248-467db0c843a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:03.600283 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77dd4968-8ec8-4060-b248-467db0c843a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:03.600719 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77dd4968-8ec8-4060-b248-467db0c843a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:03.731751 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-77dd4968-8ec8-4060-b248-467db0c843a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:03.740236 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-77dd4968-8ec8-4060-b248-467db0c843a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:03.741725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-77dd4968-8ec8-4060-b248-467db0c843a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:03.742821 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-77dd4968-8ec8-4060-b248-467db0c843a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.156880 Aug 01 07:42:03.743606 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 335/653] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:03 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:04.168878 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6349b944-03d4-47b4-b1ef-321e8c8576e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:04.169602 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6349b944-03d4-47b4-b1ef-321e8c8576e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:04.176851 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6349b944-03d4-47b4-b1ef-321e8c8576e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:04.177300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6349b944-03d4-47b4-b1ef-321e8c8576e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:04.178058 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6349b944-03d4-47b4-b1ef-321e8c8576e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:04.178494 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6349b944-03d4-47b4-b1ef-321e8c8576e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:04.308963 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6349b944-03d4-47b4-b1ef-321e8c8576e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:04.316887 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6349b944-03d4-47b4-b1ef-321e8c8576e5 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.151858 Aug 01 07:42:04.317448 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 319/654] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:04 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:04.766475 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c70effdb-8b28-4eea-b6a8-bcacf8b1892e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:04.767851 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c70effdb-8b28-4eea-b6a8-bcacf8b1892e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:04.774346 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c70effdb-8b28-4eea-b6a8-bcacf8b1892e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:04.774795 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c70effdb-8b28-4eea-b6a8-bcacf8b1892e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:04.775621 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c70effdb-8b28-4eea-b6a8-bcacf8b1892e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:04.776060 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c70effdb-8b28-4eea-b6a8-bcacf8b1892e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:04.904845 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c70effdb-8b28-4eea-b6a8-bcacf8b1892e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:04.913096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c70effdb-8b28-4eea-b6a8-bcacf8b1892e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:04.914591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c70effdb-8b28-4eea-b6a8-bcacf8b1892e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:04.915716 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c70effdb-8b28-4eea-b6a8-bcacf8b1892e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.153207 Aug 01 07:42:04.916274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 336/655] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:04 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:05.338652 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a6d8c68c-247e-4822-9c5c-bd13f00e211e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:05.339308 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a6d8c68c-247e-4822-9c5c-bd13f00e211e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:05.346092 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a6d8c68c-247e-4822-9c5c-bd13f00e211e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:05.346544 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a6d8c68c-247e-4822-9c5c-bd13f00e211e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:05.347339 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a6d8c68c-247e-4822-9c5c-bd13f00e211e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:05.347777 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a6d8c68c-247e-4822-9c5c-bd13f00e211e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:05.476764 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a6d8c68c-247e-4822-9c5c-bd13f00e211e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:05.484734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a6d8c68c-247e-4822-9c5c-bd13f00e211e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.150042 Aug 01 07:42:05.485313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 320/656] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:05 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:05.938320 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d5d81ee4-5034-49e4-bb52-fe45c2adfca1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:05.938934 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d5d81ee4-5034-49e4-bb52-fe45c2adfca1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:05.945512 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d5d81ee4-5034-49e4-bb52-fe45c2adfca1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:05.945966 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d5d81ee4-5034-49e4-bb52-fe45c2adfca1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:05.946732 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d5d81ee4-5034-49e4-bb52-fe45c2adfca1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:05.947270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d5d81ee4-5034-49e4-bb52-fe45c2adfca1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:06.078560 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d5d81ee4-5034-49e4-bb52-fe45c2adfca1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:06.087447 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d5d81ee4-5034-49e4-bb52-fe45c2adfca1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:06.088941 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d5d81ee4-5034-49e4-bb52-fe45c2adfca1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:06.090042 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d5d81ee4-5034-49e4-bb52-fe45c2adfca1 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.155710 Aug 01 07:42:06.090623 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 337/657] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:05 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:06.507134 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9bc9e168-31d5-4f83-986a-59d5ac2b2f4d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:06.508424 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9bc9e168-31d5-4f83-986a-59d5ac2b2f4d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:06.522847 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9bc9e168-31d5-4f83-986a-59d5ac2b2f4d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:06.523363 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9bc9e168-31d5-4f83-986a-59d5ac2b2f4d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:06.524167 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9bc9e168-31d5-4f83-986a-59d5ac2b2f4d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:06.524611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9bc9e168-31d5-4f83-986a-59d5ac2b2f4d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:06.672008 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9bc9e168-31d5-4f83-986a-59d5ac2b2f4d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:06.682233 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9bc9e168-31d5-4f83-986a-59d5ac2b2f4d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.178907 Aug 01 07:42:06.682725 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 321/658] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:06 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:07.113414 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c4c58e65-3752-4445-88f6-7f31562c70f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:07.114978 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c4c58e65-3752-4445-88f6-7f31562c70f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:07.121606 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c4c58e65-3752-4445-88f6-7f31562c70f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:07.122378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c4c58e65-3752-4445-88f6-7f31562c70f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:07.123431 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c4c58e65-3752-4445-88f6-7f31562c70f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:07.123927 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c4c58e65-3752-4445-88f6-7f31562c70f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:07.253486 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c4c58e65-3752-4445-88f6-7f31562c70f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:07.261397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c4c58e65-3752-4445-88f6-7f31562c70f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:07.262895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c4c58e65-3752-4445-88f6-7f31562c70f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:07.264358 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c4c58e65-3752-4445-88f6-7f31562c70f3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.154669 Aug 01 07:42:07.264919 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 338/659] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:07 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:07.703541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-31ea2ca3-49a4-4e6d-97b1-4e265973419b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:07.704154 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-31ea2ca3-49a4-4e6d-97b1-4e265973419b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:07.710739 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-31ea2ca3-49a4-4e6d-97b1-4e265973419b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:07.711222 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-31ea2ca3-49a4-4e6d-97b1-4e265973419b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:07.711988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-31ea2ca3-49a4-4e6d-97b1-4e265973419b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:07.712428 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-31ea2ca3-49a4-4e6d-97b1-4e265973419b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:07.945455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-31ea2ca3-49a4-4e6d-97b1-4e265973419b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:07.953582 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-31ea2ca3-49a4-4e6d-97b1-4e265973419b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.253823 Aug 01 07:42:07.954243 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 322/660] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:07 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:08.287825 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-fb5f8359-0b39-42c4-8a05-9915092a676e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:08.288423 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-fb5f8359-0b39-42c4-8a05-9915092a676e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:08.294900 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb5f8359-0b39-42c4-8a05-9915092a676e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:08.295372 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb5f8359-0b39-42c4-8a05-9915092a676e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:08.296122 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb5f8359-0b39-42c4-8a05-9915092a676e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:08.296549 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb5f8359-0b39-42c4-8a05-9915092a676e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:08.431340 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fb5f8359-0b39-42c4-8a05-9915092a676e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:08.439514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fb5f8359-0b39-42c4-8a05-9915092a676e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:08.440891 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fb5f8359-0b39-42c4-8a05-9915092a676e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:08.441991 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-fb5f8359-0b39-42c4-8a05-9915092a676e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.158089 Aug 01 07:42:08.442548 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 339/661] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:08 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:08.594400 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-d5ff6f38-68cc-4abc-9110-6f02762ce511 req-00109fb5-f120-4341-88e5-22042f9b580d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f30f324-1dcf-44b9-b81d-ef96811b0a87", "name": "network-vif-plugged", "status": "completed", "tag": "23ceaa56-07cb-42cc-83de-2bfdae7aac98"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:08.599778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:08.607296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-d5ff6f38-68cc-4abc-9110-6f02762ce511 req-00109fb5-f120-4341-88e5-22042f9b580d service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:08.608313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-d5ff6f38-68cc-4abc-9110-6f02762ce511 req-00109fb5-f120-4341-88e5-22042f9b580d service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:08.619800 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-d5ff6f38-68cc-4abc-9110-6f02762ce511 req-00109fb5-f120-4341-88e5-22042f9b580d service nova] Creating event network-vif-plugged:23ceaa56-07cb-42cc-83de-2bfdae7aac98 for instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 on hv-cinder-73306 Aug 01 07:42:08.625190 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-d5ff6f38-68cc-4abc-9110-6f02762ce511 req-00109fb5-f120-4341-88e5-22042f9b580d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034587 Aug 01 07:42:08.625780 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 323/662] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:08.976326 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d00fd95d-f5b9-4db1-abe6-d9e05869d628 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:08.976946 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d00fd95d-f5b9-4db1-abe6-d9e05869d628 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:08.982945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d00fd95d-f5b9-4db1-abe6-d9e05869d628 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:08.983434 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d00fd95d-f5b9-4db1-abe6-d9e05869d628 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:08.984204 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d00fd95d-f5b9-4db1-abe6-d9e05869d628 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:08.984639 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d00fd95d-f5b9-4db1-abe6-d9e05869d628 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:09.161240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d00fd95d-f5b9-4db1-abe6-d9e05869d628 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:09.169043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d00fd95d-f5b9-4db1-abe6-d9e05869d628 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.196574 Aug 01 07:42:09.169611 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 340/663] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:08 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:09.465956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-134cb4e6-7125-42f4-a137-6519a0e5064a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:09.466646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-134cb4e6-7125-42f4-a137-6519a0e5064a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:09.474109 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-134cb4e6-7125-42f4-a137-6519a0e5064a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:09.474557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-134cb4e6-7125-42f4-a137-6519a0e5064a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:09.475340 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-134cb4e6-7125-42f4-a137-6519a0e5064a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:09.475776 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-134cb4e6-7125-42f4-a137-6519a0e5064a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:09.606722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-134cb4e6-7125-42f4-a137-6519a0e5064a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:09.615562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-134cb4e6-7125-42f4-a137-6519a0e5064a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:09.617058 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-134cb4e6-7125-42f4-a137-6519a0e5064a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:09.618156 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-134cb4e6-7125-42f4-a137-6519a0e5064a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.156424 Aug 01 07:42:09.618789 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 324/664] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:09 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:42:10.191514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e8be5f89-6ace-4eb4-9ff7-fba7cbf7e92e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:10.192113 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e8be5f89-6ace-4eb4-9ff7-fba7cbf7e92e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:10.198797 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e8be5f89-6ace-4eb4-9ff7-fba7cbf7e92e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:10.199322 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e8be5f89-6ace-4eb4-9ff7-fba7cbf7e92e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:10.200072 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e8be5f89-6ace-4eb4-9ff7-fba7cbf7e92e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:10.200502 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e8be5f89-6ace-4eb4-9ff7-fba7cbf7e92e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:10.237695 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=6 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:10.332305 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e8be5f89-6ace-4eb4-9ff7-fba7cbf7e92e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:10.341693 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e8be5f89-6ace-4eb4-9ff7-fba7cbf7e92e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.154484 Aug 01 07:42:10.342266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 341/665] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:10 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:10.640272 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3f273065-298a-4544-a8d0-6370e6941efc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:10.640884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3f273065-298a-4544-a8d0-6370e6941efc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:10.642877 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:10.643577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=6 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:10.650364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3f273065-298a-4544-a8d0-6370e6941efc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:10.650824 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3f273065-298a-4544-a8d0-6370e6941efc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:10.651627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3f273065-298a-4544-a8d0-6370e6941efc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:10.652071 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3f273065-298a-4544-a8d0-6370e6941efc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:10.655952 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=100 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:10.778122 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3f273065-298a-4544-a8d0-6370e6941efc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:10.786105 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3f273065-298a-4544-a8d0-6370e6941efc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:10.787623 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3f273065-298a-4544-a8d0-6370e6941efc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:10.788713 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3f273065-298a-4544-a8d0-6370e6941efc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.152343 Aug 01 07:42:10.789267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 325/666] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:10 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:11.363887 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-681cb4bc-ba59-4926-a974-ca1d2e884d1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:11.364482 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-681cb4bc-ba59-4926-a974-ca1d2e884d1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:11.371109 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-681cb4bc-ba59-4926-a974-ca1d2e884d1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:11.371562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-681cb4bc-ba59-4926-a974-ca1d2e884d1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:11.372353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-681cb4bc-ba59-4926-a974-ca1d2e884d1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:11.372782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-681cb4bc-ba59-4926-a974-ca1d2e884d1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:11.504119 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-681cb4bc-ba59-4926-a974-ca1d2e884d1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:11.512009 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-681cb4bc-ba59-4926-a974-ca1d2e884d1b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1733 microversion: 2.1 time: 0.152381 Aug 01 07:42:11.512571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 342/667] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:11 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:11.811587 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9f93a3bd-4e15-411a-ae22-d8f7a5779c20 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:11.812121 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9f93a3bd-4e15-411a-ae22-d8f7a5779c20 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:11.819115 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9f93a3bd-4e15-411a-ae22-d8f7a5779c20 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:11.819577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9f93a3bd-4e15-411a-ae22-d8f7a5779c20 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:11.820349 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9f93a3bd-4e15-411a-ae22-d8f7a5779c20 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:11.820811 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9f93a3bd-4e15-411a-ae22-d8f7a5779c20 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:11.953688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9f93a3bd-4e15-411a-ae22-d8f7a5779c20 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:11.963238 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9f93a3bd-4e15-411a-ae22-d8f7a5779c20 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:11.964213 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9f93a3bd-4e15-411a-ae22-d8f7a5779c20 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:11.964929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9f93a3bd-4e15-411a-ae22-d8f7a5779c20 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.157349 Aug 01 07:42:11.965670 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 326/668] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:11 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:12.533764 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-202e3b8c-d886-43e4-9b87-30ddb43d83f0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:12.535020 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-202e3b8c-d886-43e4-9b87-30ddb43d83f0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:12.542447 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-202e3b8c-d886-43e4-9b87-30ddb43d83f0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:12.542937 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-202e3b8c-d886-43e4-9b87-30ddb43d83f0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:12.543734 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-202e3b8c-d886-43e4-9b87-30ddb43d83f0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:12.544174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-202e3b8c-d886-43e4-9b87-30ddb43d83f0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:12.672402 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-202e3b8c-d886-43e4-9b87-30ddb43d83f0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:12.681161 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-202e3b8c-d886-43e4-9b87-30ddb43d83f0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1713 microversion: 2.1 time: 0.151328 Aug 01 07:42:12.681724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 343/669] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:12 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:12.789452 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1d69250e-8fbb-4e0e-9eff-530b72bf5f6f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:12.789919 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1d69250e-8fbb-4e0e-9eff-530b72bf5f6f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:12.795917 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d69250e-8fbb-4e0e-9eff-530b72bf5f6f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:12.796365 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d69250e-8fbb-4e0e-9eff-530b72bf5f6f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:12.797126 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d69250e-8fbb-4e0e-9eff-530b72bf5f6f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:12.797569 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d69250e-8fbb-4e0e-9eff-530b72bf5f6f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:12.878583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-1d69250e-8fbb-4e0e-9eff-530b72bf5f6f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] HTTP exception thrown: Cannot 'detach_volume' instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d while it is in vm_state rescued Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1d69250e-8fbb-4e0e-9eff-530b72bf5f6f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Request method failure captured: Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments/c284000c-5005-49f6-91fe-6ca78aa4b59f HTTP/1.1 Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54Kyn7fgIOOlVQOe_iFzrxEhB5ZYfzP1N8kO7rOTuHfs3DHd50pdfNgKj05xoWbt8QDwaQiYV_jIV6PjClEExJj62j4pbOtwtSh24VBb1HaRP4_5Y1KFfIh0Ovn_SXpns93svbDb6A4SjUYl1K4CRkFTtLkXpwu2IlYTEfOiQxSjxW0 Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 015cc91d3e2f4d3791301c05e4c8be20 Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:42:12.880206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 015cc91d3e2f4d3791301c05e4c8be20 Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-ServerRescueNegativeTestJSON-86514510-project Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: db6ac4cf9dd84e338f944b4905dcdb50 Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-ServerRescueNegativeTestJSON-86514510-project Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:42:12.881814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Cannot 'detach_volume' instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d while it is in vm_state rescued Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'server_id': '13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d', 'id': 'c284000c-5005-49f6-91fe-6ca78aa4b59f'} Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:42:12.882572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d while it is in vm_state rescued Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d while it is in vm_state rescued Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:42:12.883873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1d69250e-8fbb-4e0e-9eff-530b72bf5f6f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Returning 409 to user: Cannot 'detach_volume' instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d while it is in vm_state rescued {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:42:12.884833 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1d69250e-8fbb-4e0e-9eff-530b72bf5f6f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "DELETE /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments/c284000c-5005-49f6-91fe-6ca78aa4b59f" status: 409 len: 152 microversion: 2.1 time: 0.096309 Aug 01 07:42:12.884833 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 327/670] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:42:12 2022] DELETE /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments/c284000c-5005-49f6-91fe-6ca78aa4b59f => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 07:42:12.890381 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-07850522-8a13-4345-937a-7ec7a3ea2219 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:12.890916 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-07850522-8a13-4345-937a-7ec7a3ea2219 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:12.897675 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07850522-8a13-4345-937a-7ec7a3ea2219 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:12.898124 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07850522-8a13-4345-937a-7ec7a3ea2219 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:12.898881 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07850522-8a13-4345-937a-7ec7a3ea2219 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:12.899359 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07850522-8a13-4345-937a-7ec7a3ea2219 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:12.965547 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-07850522-8a13-4345-937a-7ec7a3ea2219 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "POST /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/action" status: 202 len: 0 microversion: 2.1 time: 0.078791 Aug 01 07:42:12.968457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 344/671] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:42:12 2022] POST /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:42:12.974918 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3db5908b-f3bd-4a71-a50a-c8f1c6ad5a3f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:12.975558 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3db5908b-f3bd-4a71-a50a-c8f1c6ad5a3f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:12.981591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3db5908b-f3bd-4a71-a50a-c8f1c6ad5a3f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:12.983230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3db5908b-f3bd-4a71-a50a-c8f1c6ad5a3f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:12.984081 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3db5908b-f3bd-4a71-a50a-c8f1c6ad5a3f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:12.984533 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3db5908b-f3bd-4a71-a50a-c8f1c6ad5a3f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:12.988844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9750d1e7-7a04-44b0-a538-b6cb571deac9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:12.989532 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9750d1e7-7a04-44b0-a538-b6cb571deac9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:12.995720 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9750d1e7-7a04-44b0-a538-b6cb571deac9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:12.996167 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9750d1e7-7a04-44b0-a538-b6cb571deac9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:12.996922 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9750d1e7-7a04-44b0-a538-b6cb571deac9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:12.997354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9750d1e7-7a04-44b0-a538-b6cb571deac9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:13.119046 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3db5908b-f3bd-4a71-a50a-c8f1c6ad5a3f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:13.127443 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3db5908b-f3bd-4a71-a50a-c8f1c6ad5a3f tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1721 microversion: 2.1 time: 0.156740 Aug 01 07:42:13.128609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 328/672] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:12 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:13.134048 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9750d1e7-7a04-44b0-a538-b6cb571deac9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:13.141965 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9750d1e7-7a04-44b0-a538-b6cb571deac9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:13.144979 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9750d1e7-7a04-44b0-a538-b6cb571deac9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:13.146082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9750d1e7-7a04-44b0-a538-b6cb571deac9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.161669 Aug 01 07:42:13.146625 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 345/673] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:12 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:42:14.149677 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-01d0e426-9fcb-4f2a-a2ab-f9545af2ed70 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:14.150202 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-01d0e426-9fcb-4f2a-a2ab-f9545af2ed70 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:14.156625 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-01d0e426-9fcb-4f2a-a2ab-f9545af2ed70 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:14.157104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-01d0e426-9fcb-4f2a-a2ab-f9545af2ed70 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:14.157860 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-01d0e426-9fcb-4f2a-a2ab-f9545af2ed70 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:14.158295 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-01d0e426-9fcb-4f2a-a2ab-f9545af2ed70 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:14.168158 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3b086a77-2f84-4693-a8fb-4c3b4e26edc0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:14.168774 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3b086a77-2f84-4693-a8fb-4c3b4e26edc0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:14.175943 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3b086a77-2f84-4693-a8fb-4c3b4e26edc0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:14.176406 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3b086a77-2f84-4693-a8fb-4c3b4e26edc0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:14.177177 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3b086a77-2f84-4693-a8fb-4c3b4e26edc0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:14.177616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3b086a77-2f84-4693-a8fb-4c3b4e26edc0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:14.289756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-01d0e426-9fcb-4f2a-a2ab-f9545af2ed70 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:14.297717 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-01d0e426-9fcb-4f2a-a2ab-f9545af2ed70 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1721 microversion: 2.1 time: 0.151952 Aug 01 07:42:14.298296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 329/674] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:14 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:14.307823 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3b086a77-2f84-4693-a8fb-4c3b4e26edc0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:14.315808 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3b086a77-2f84-4693-a8fb-4c3b4e26edc0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:14.317285 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3b086a77-2f84-4693-a8fb-4c3b4e26edc0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:14.318455 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3b086a77-2f84-4693-a8fb-4c3b4e26edc0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.154151 Aug 01 07:42:14.319009 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 346/675] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:14 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:42:15.319821 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-34117716-e12e-4d53-b803-4c70cc51bd9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:15.320339 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-34117716-e12e-4d53-b803-4c70cc51bd9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:15.326815 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34117716-e12e-4d53-b803-4c70cc51bd9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:15.327305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34117716-e12e-4d53-b803-4c70cc51bd9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:15.328063 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34117716-e12e-4d53-b803-4c70cc51bd9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:15.328504 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-34117716-e12e-4d53-b803-4c70cc51bd9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:15.345433 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ed1bf269-8459-4d20-855b-e2cda846a705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:15.346036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ed1bf269-8459-4d20-855b-e2cda846a705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:15.353189 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ed1bf269-8459-4d20-855b-e2cda846a705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:15.353631 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ed1bf269-8459-4d20-855b-e2cda846a705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:15.354387 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ed1bf269-8459-4d20-855b-e2cda846a705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:15.354818 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ed1bf269-8459-4d20-855b-e2cda846a705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:15.460708 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-34117716-e12e-4d53-b803-4c70cc51bd9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:15.468695 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-34117716-e12e-4d53-b803-4c70cc51bd9b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1721 microversion: 2.1 time: 0.152999 Aug 01 07:42:15.469256 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 330/676] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:15 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:15.490118 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ed1bf269-8459-4d20-855b-e2cda846a705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:15.497930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ed1bf269-8459-4d20-855b-e2cda846a705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:15.499455 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ed1bf269-8459-4d20-855b-e2cda846a705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:15.500553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ed1bf269-8459-4d20-855b-e2cda846a705 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.158900 Aug 01 07:42:15.501110 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 347/677] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:15 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:42:16.490843 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6e630bce-de8b-4d2d-ab10-7d90fb1974af tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:16.491486 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6e630bce-de8b-4d2d-ab10-7d90fb1974af tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:16.497992 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6e630bce-de8b-4d2d-ab10-7d90fb1974af tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:16.498443 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6e630bce-de8b-4d2d-ab10-7d90fb1974af tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:16.499250 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6e630bce-de8b-4d2d-ab10-7d90fb1974af tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:16.499690 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6e630bce-de8b-4d2d-ab10-7d90fb1974af tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:16.523889 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b67235d9-6073-4978-ae7d-3a38d9a6f47e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:16.524641 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b67235d9-6073-4978-ae7d-3a38d9a6f47e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:16.531279 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b67235d9-6073-4978-ae7d-3a38d9a6f47e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:16.531744 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b67235d9-6073-4978-ae7d-3a38d9a6f47e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:16.532516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b67235d9-6073-4978-ae7d-3a38d9a6f47e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:16.532981 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b67235d9-6073-4978-ae7d-3a38d9a6f47e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:16.673922 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b67235d9-6073-4978-ae7d-3a38d9a6f47e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:16.683153 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b67235d9-6073-4978-ae7d-3a38d9a6f47e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:16.684973 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b67235d9-6073-4978-ae7d-3a38d9a6f47e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:16.686300 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b67235d9-6073-4978-ae7d-3a38d9a6f47e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1408 microversion: 2.20 time: 0.166392 Aug 01 07:42:16.687628 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 348/678] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:16 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:42:16.733737 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6e630bce-de8b-4d2d-ab10-7d90fb1974af tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:16.741833 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6e630bce-de8b-4d2d-ab10-7d90fb1974af tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1721 microversion: 2.1 time: 0.255910 Aug 01 07:42:16.742405 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 331/679] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:16 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:17.712792 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-44d9c224-ae1d-49b7-9ca2-27ea735e7ad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:17.713407 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-44d9c224-ae1d-49b7-9ca2-27ea735e7ad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:17.720241 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-44d9c224-ae1d-49b7-9ca2-27ea735e7ad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:17.720406 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-44d9c224-ae1d-49b7-9ca2-27ea735e7ad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:17.721176 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-44d9c224-ae1d-49b7-9ca2-27ea735e7ad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:17.721780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-44d9c224-ae1d-49b7-9ca2-27ea735e7ad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:17.770304 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-aec30530-b63e-4336-bb47-1d6291400b09 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:17.770946 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-aec30530-b63e-4336-bb47-1d6291400b09 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:17.777603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aec30530-b63e-4336-bb47-1d6291400b09 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:17.778057 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aec30530-b63e-4336-bb47-1d6291400b09 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:17.778820 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aec30530-b63e-4336-bb47-1d6291400b09 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:17.779303 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aec30530-b63e-4336-bb47-1d6291400b09 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:17.863434 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-44d9c224-ae1d-49b7-9ca2-27ea735e7ad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:17.871678 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-44d9c224-ae1d-49b7-9ca2-27ea735e7ad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:17.873274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-44d9c224-ae1d-49b7-9ca2-27ea735e7ad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:17.874571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-44d9c224-ae1d-49b7-9ca2-27ea735e7ad6 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1599 microversion: 2.20 time: 0.165672 Aug 01 07:42:17.875237 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 349/680] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:42:17 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:42:17.898023 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-77d24304-ac11-4dc2-93a4-d0cdc941512e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:17.898386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-77d24304-ac11-4dc2-93a4-d0cdc941512e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:17.904357 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77d24304-ac11-4dc2-93a4-d0cdc941512e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:17.904808 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77d24304-ac11-4dc2-93a4-d0cdc941512e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:17.905563 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77d24304-ac11-4dc2-93a4-d0cdc941512e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:17.905994 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77d24304-ac11-4dc2-93a4-d0cdc941512e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:17.913055 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-aec30530-b63e-4336-bb47-1d6291400b09 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:17.920925 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-aec30530-b63e-4336-bb47-1d6291400b09 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1721 microversion: 2.1 time: 0.155278 Aug 01 07:42:17.921499 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 332/681] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:17 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:17.923454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:17.996189 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-77d24304-ac11-4dc2-93a4-d0cdc941512e tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102547 Aug 01 07:42:17.996910 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 350/682] 10.222.0.40 () {60 vars in 1316 bytes} [Mon Aug 1 07:42:17 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:42:18.923058 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-fc615451-fe4c-431e-b88b-5ebf2ceeab08 req-e1e084f5-ac05-4b22-8097-169bf1afd608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f30f324-1dcf-44b9-b81d-ef96811b0a87", "tag": "23ceaa56-07cb-42cc-83de-2bfdae7aac98"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:18.932936 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-fc615451-fe4c-431e-b88b-5ebf2ceeab08 req-e1e084f5-ac05-4b22-8097-169bf1afd608 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:18.933384 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-fc615451-fe4c-431e-b88b-5ebf2ceeab08 req-e1e084f5-ac05-4b22-8097-169bf1afd608 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:18.943799 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1bc4f161-d338-48ba-a424-916efdb5df4e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:18.944726 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-fc615451-fe4c-431e-b88b-5ebf2ceeab08 req-e1e084f5-ac05-4b22-8097-169bf1afd608 service nova] Creating event network-changed:23ceaa56-07cb-42cc-83de-2bfdae7aac98 for instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 on hv-cinder-73306 Aug 01 07:42:18.950212 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-fc615451-fe4c-431e-b88b-5ebf2ceeab08 req-e1e084f5-ac05-4b22-8097-169bf1afd608 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030807 Aug 01 07:42:18.952904 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1bc4f161-d338-48ba-a424-916efdb5df4e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:18.953796 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 333/683] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:42:18.960744 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1bc4f161-d338-48ba-a424-916efdb5df4e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:18.961196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1bc4f161-d338-48ba-a424-916efdb5df4e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:18.961959 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1bc4f161-d338-48ba-a424-916efdb5df4e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:18.962391 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1bc4f161-d338-48ba-a424-916efdb5df4e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:19.098067 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1bc4f161-d338-48ba-a424-916efdb5df4e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:19.106864 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1bc4f161-d338-48ba-a424-916efdb5df4e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1721 microversion: 2.1 time: 0.167097 Aug 01 07:42:19.107545 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 351/684] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:18 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:19.943614 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-26fcdb76-b41b-4149-962c-f91b16e5d3d7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:19.944194 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-26fcdb76-b41b-4149-962c-f91b16e5d3d7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:19.951183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-26fcdb76-b41b-4149-962c-f91b16e5d3d7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:19.951638 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-26fcdb76-b41b-4149-962c-f91b16e5d3d7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:19.952406 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-26fcdb76-b41b-4149-962c-f91b16e5d3d7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:19.952896 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-26fcdb76-b41b-4149-962c-f91b16e5d3d7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:20.043141 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-26fcdb76-b41b-4149-962c-f91b16e5d3d7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lazy-loading 'services' on Instance uuid abaea826-3743-471a-94d3-bc4c726b2ccb {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:42:20.116883 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-26fcdb76-b41b-4149-962c-f91b16e5d3d7 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "DELETE /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb/os-volume_attachments/c80e4935-05a9-4aa8-8c42-ac070e2d8122" status: 202 len: 0 microversion: 2.1 time: 0.178082 Aug 01 07:42:20.117508 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 334/685] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:42:19 2022] DELETE /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb/os-volume_attachments/c80e4935-05a9-4aa8-8c42-ac070e2d8122 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:42:20.130216 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-09f033c6-c216-42e1-97c1-f527da8dd27e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:20.132068 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-09f033c6-c216-42e1-97c1-f527da8dd27e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:20.133497 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:20.138933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-09f033c6-c216-42e1-97c1-f527da8dd27e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:20.139526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-09f033c6-c216-42e1-97c1-f527da8dd27e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:20.140850 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-09f033c6-c216-42e1-97c1-f527da8dd27e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:20.141694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-09f033c6-c216-42e1-97c1-f527da8dd27e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:20.277950 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-09f033c6-c216-42e1-97c1-f527da8dd27e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:20.286607 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-09f033c6-c216-42e1-97c1-f527da8dd27e tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1721 microversion: 2.1 time: 0.161186 Aug 01 07:42:20.287199 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 352/686] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:20 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:21.308576 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-29a6e451-a8c8-426b-b89f-033ea9225fc0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:21.309267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-29a6e451-a8c8-426b-b89f-033ea9225fc0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:21.316883 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29a6e451-a8c8-426b-b89f-033ea9225fc0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:21.317337 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29a6e451-a8c8-426b-b89f-033ea9225fc0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:21.318184 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29a6e451-a8c8-426b-b89f-033ea9225fc0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:21.318651 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-29a6e451-a8c8-426b-b89f-033ea9225fc0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:21.463109 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-29a6e451-a8c8-426b-b89f-033ea9225fc0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:21.471977 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-29a6e451-a8c8-426b-b89f-033ea9225fc0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1727 microversion: 2.1 time: 0.167423 Aug 01 07:42:21.472560 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 335/687] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:21 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:21.492806 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-20bd65b6-8fb8-47d1-b6b1-2f1d269843be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:21.493340 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-20bd65b6-8fb8-47d1-b6b1-2f1d269843be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:21.499803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-20bd65b6-8fb8-47d1-b6b1-2f1d269843be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:21.500247 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-20bd65b6-8fb8-47d1-b6b1-2f1d269843be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:21.500993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-20bd65b6-8fb8-47d1-b6b1-2f1d269843be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:21.501421 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-20bd65b6-8fb8-47d1-b6b1-2f1d269843be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:21.582119 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-20bd65b6-8fb8-47d1-b6b1-2f1d269843be tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093150 Aug 01 07:42:21.582711 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 353/688] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 1 07:42:21 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:22.305939 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-13588aec-9cdb-4db6-9bc3-f592700330d0 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:22.306539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-13588aec-9cdb-4db6-9bc3-f592700330d0 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:22.312770 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13588aec-9cdb-4db6-9bc3-f592700330d0 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:22.313415 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13588aec-9cdb-4db6-9bc3-f592700330d0 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:22.314296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13588aec-9cdb-4db6-9bc3-f592700330d0 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:22.315422 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-13588aec-9cdb-4db6-9bc3-f592700330d0 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:22.342264 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-13588aec-9cdb-4db6-9bc3-f592700330d0 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Going to try to terminate instance {{(pid=124280) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:42:22.420390 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-13588aec-9cdb-4db6-9bc3-f592700330d0 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "DELETE /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 204 len: 0 microversion: 2.1 time: 0.118108 Aug 01 07:42:22.421238 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 336/689] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:42:22 2022] DELETE /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:42:22.430094 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2e16ebd4-a4b5-4461-bad9-f331105adaf6 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:22.430790 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2e16ebd4-a4b5-4461-bad9-f331105adaf6 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:22.436961 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e16ebd4-a4b5-4461-bad9-f331105adaf6 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:22.437483 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e16ebd4-a4b5-4461-bad9-f331105adaf6 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:22.438428 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e16ebd4-a4b5-4461-bad9-f331105adaf6 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:22.438869 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2e16ebd4-a4b5-4461-bad9-f331105adaf6 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:22.868867 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2e16ebd4-a4b5-4461-bad9-f331105adaf6 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:22.878827 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2e16ebd4-a4b5-4461-bad9-f331105adaf6 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1513 microversion: 2.1 time: 0.452469 Aug 01 07:42:22.879660 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 354/690] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:22 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1513 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:22.882512 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-8e6358d6-019d-4b3c-b56c-0f5322f486d1 req-4a7bd11b-dbfb-45b3-9452-d25b99d9c9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d", "tag": "62003bcf-02f7-4b14-97e3-6fad5084dd62"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:22.892189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-8e6358d6-019d-4b3c-b56c-0f5322f486d1 req-4a7bd11b-dbfb-45b3-9452-d25b99d9c9d6 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:22.892642 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-8e6358d6-019d-4b3c-b56c-0f5322f486d1 req-4a7bd11b-dbfb-45b3-9452-d25b99d9c9d6 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:22.905266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-8e6358d6-019d-4b3c-b56c-0f5322f486d1 req-4a7bd11b-dbfb-45b3-9452-d25b99d9c9d6 service nova] Creating event network-changed:62003bcf-02f7-4b14-97e3-6fad5084dd62 for instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d on hv-cinder-73306 Aug 01 07:42:22.910557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-8e6358d6-019d-4b3c-b56c-0f5322f486d1 req-4a7bd11b-dbfb-45b3-9452-d25b99d9c9d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032007 Aug 01 07:42:22.911466 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 337/691] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:42:23.906030 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-31056fd5-9f7b-4c8c-8cac-bd1231705ab1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:23.906567 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-31056fd5-9f7b-4c8c-8cac-bd1231705ab1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:23.913190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31056fd5-9f7b-4c8c-8cac-bd1231705ab1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:23.913641 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31056fd5-9f7b-4c8c-8cac-bd1231705ab1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:23.914404 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31056fd5-9f7b-4c8c-8cac-bd1231705ab1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:23.914840 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-31056fd5-9f7b-4c8c-8cac-bd1231705ab1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:24.054217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-31056fd5-9f7b-4c8c-8cac-bd1231705ab1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:24.062111 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-31056fd5-9f7b-4c8c-8cac-bd1231705ab1 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1513 microversion: 2.1 time: 0.159975 Aug 01 07:42:24.062701 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 355/692] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:23 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:24.927594 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-7f3039ba-c220-4e6c-9155-6905e07dd713 req-1f5f45b1-eed6-47c3-b911-1662071dbc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d", "tag": "62003bcf-02f7-4b14-97e3-6fad5084dd62"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:24.937769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-7f3039ba-c220-4e6c-9155-6905e07dd713 req-1f5f45b1-eed6-47c3-b911-1662071dbc8c service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:24.938211 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-7f3039ba-c220-4e6c-9155-6905e07dd713 req-1f5f45b1-eed6-47c3-b911-1662071dbc8c service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:24.966305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-7f3039ba-c220-4e6c-9155-6905e07dd713 req-1f5f45b1-eed6-47c3-b911-1662071dbc8c service nova] Creating event network-changed:62003bcf-02f7-4b14-97e3-6fad5084dd62 for instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d on hv-cinder-73306 Aug 01 07:42:24.971852 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-7f3039ba-c220-4e6c-9155-6905e07dd713 req-1f5f45b1-eed6-47c3-b911-1662071dbc8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048288 Aug 01 07:42:24.973170 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 338/693] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:25.037904 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-7a007371-b5e1-4653-ba2d-f298c39fde78 req-add4f332-658a-4a04-8774-3560f589f507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abaea826-3743-471a-94d3-bc4c726b2ccb", "name": "network-vif-deleted", "tag": "90e22fc0-ea0f-4c8c-81e7-22368b17e626"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:25.049030 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-7a007371-b5e1-4653-ba2d-f298c39fde78 req-add4f332-658a-4a04-8774-3560f589f507 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:25.049674 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-7a007371-b5e1-4653-ba2d-f298c39fde78 req-add4f332-658a-4a04-8774-3560f589f507 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:25.061343 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-7a007371-b5e1-4653-ba2d-f298c39fde78 req-add4f332-658a-4a04-8774-3560f589f507 service nova] Creating event network-vif-deleted:90e22fc0-ea0f-4c8c-81e7-22368b17e626 for instance abaea826-3743-471a-94d3-bc4c726b2ccb on hv-cinder-73306 Aug 01 07:42:25.067254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-7a007371-b5e1-4653-ba2d-f298c39fde78 req-add4f332-658a-4a04-8774-3560f589f507 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034196 Aug 01 07:42:25.067863 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 356/694] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:25.086837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fe3eb4df-6be5-4ed8-a746-45afef0b9338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:25.087795 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fe3eb4df-6be5-4ed8-a746-45afef0b9338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:25.095037 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe3eb4df-6be5-4ed8-a746-45afef0b9338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:25.095538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe3eb4df-6be5-4ed8-a746-45afef0b9338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:25.096718 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe3eb4df-6be5-4ed8-a746-45afef0b9338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:25.097161 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe3eb4df-6be5-4ed8-a746-45afef0b9338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:25.181940 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fe3eb4df-6be5-4ed8-a746-45afef0b9338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2bc662fa4405791532ebf2bce909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76209de52146bf8440fddcdd00b284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:25.193262 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fe3eb4df-6be5-4ed8-a746-45afef0b9338 tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 200 len: 1303 microversion: 2.1 time: 0.112573 Aug 01 07:42:25.193799 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 339/695] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:25 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:25.376672 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-07bd1b82-08fb-481f-b8f1-4407b27ecfbf tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:25.378440 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-07bd1b82-08fb-481f-b8f1-4407b27ecfbf tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:25.384838 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07bd1b82-08fb-481f-b8f1-4407b27ecfbf tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:25.385293 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07bd1b82-08fb-481f-b8f1-4407b27ecfbf tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:25.386058 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07bd1b82-08fb-481f-b8f1-4407b27ecfbf tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:25.386495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-07bd1b82-08fb-481f-b8f1-4407b27ecfbf tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:25.408670 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-07bd1b82-08fb-481f-b8f1-4407b27ecfbf tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lazy-loading 'flavor' on Instance uuid 0b28df3b-0e7f-425f-9e11-c2e34a32f31e {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:42:25.488247 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-07bd1b82-08fb-481f-b8f1-4407b27ecfbf tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "POST /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e/action" status: 202 len: 0 microversion: 2.1 time: 0.115515 Aug 01 07:42:25.488761 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 357/696] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:42:25 2022] POST /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:42:25.497076 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4442def9-fc0d-4fd2-b079-04498aac6835 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:25.498232 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4442def9-fc0d-4fd2-b079-04498aac6835 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:25.506222 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4442def9-fc0d-4fd2-b079-04498aac6835 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:25.506924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4442def9-fc0d-4fd2-b079-04498aac6835 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:25.507727 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4442def9-fc0d-4fd2-b079-04498aac6835 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:25.508163 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4442def9-fc0d-4fd2-b079-04498aac6835 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:25.689282 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4442def9-fc0d-4fd2-b079-04498aac6835 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:25.698957 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4442def9-fc0d-4fd2-b079-04498aac6835 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.205863 Aug 01 07:42:25.701451 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 340/697] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:25 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:26.215465 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bbd56031-fb8b-4cd7-854a-c2911336c60e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:26.216193 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-bbd56031-fb8b-4cd7-854a-c2911336c60e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] [instance: abaea826-3743-471a-94d3-bc4c726b2ccb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:26.223186 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bbd56031-fb8b-4cd7-854a-c2911336c60e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:26.223665 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bbd56031-fb8b-4cd7-854a-c2911336c60e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:26.224421 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bbd56031-fb8b-4cd7-854a-c2911336c60e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:26.224855 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bbd56031-fb8b-4cd7-854a-c2911336c60e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:26.238066 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-bbd56031-fb8b-4cd7-854a-c2911336c60e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] HTTP exception thrown: Instance abaea826-3743-471a-94d3-bc4c726b2ccb could not be found. Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bbd56031-fb8b-4cd7-854a-c2911336c60e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Request method failure captured: Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb HTTP/1.1 Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54NZUHj3O8Gb9hDrv8an_je-I0Qc0EYf5onU5JipZEYqFkkDiNsou5u5kJWZh0I-M3WF6IM5C8OGls9GmbjsuVstoNP5MIg0UcnzAZybEG_HAhNJCaAfrQEh3dCJSTHnNbqhnUkMAm8tmnyXP1mTj1oSRQK6Ajs91MjLho0iwiKajvo Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 4a76209de52146bf8440fddcdd00b284 Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-VolumesSnapshotTestJSON-676098174 Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:42:26.239677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a76209de52146bf8440fddcdd00b284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a76209de52146bf8440fddcdd00b284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a76209de52146bf8440fddcdd00b284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a76209de52146bf8440fddcdd00b284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-VolumesSnapshotTestJSON-676098174 Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 4a76209de52146bf8440fddcdd00b284 Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-676098174 Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-VolumesSnapshotTestJSON-676098174-project Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 42a2bc662fa4405791532ebf2bce909c Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-VolumesSnapshotTestJSON-676098174-project Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance abaea826-3743-471a-94d3-bc4c726b2ccb could not be found. Aug 01 07:42:26.241246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': 'abaea826-3743-471a-94d3-bc4c726b2ccb'} Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abaea826-3743-471a-94d3-bc4c726b2ccb could not be found. Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:42:26.242217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abaea826-3743-471a-94d3-bc4c726b2ccb could not be found. Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abaea826-3743-471a-94d3-bc4c726b2ccb could not be found. Aug 01 07:42:26.243490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:42:26.244600 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bbd56031-fb8b-4cd7-854a-c2911336c60e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] Returning 404 to user: Instance abaea826-3743-471a-94d3-bc4c726b2ccb could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:42:26.244600 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-bbd56031-fb8b-4cd7-854a-c2911336c60e tempest-VolumesSnapshotTestJSON-676098174 tempest-VolumesSnapshotTestJSON-676098174-project] 10.222.0.40 "GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb" status: 404 len: 111 microversion: 2.1 time: 0.030267 Aug 01 07:42:26.244600 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 358/698] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:26 2022] GET /compute/v2.1/servers/abaea826-3743-471a-94d3-bc4c726b2ccb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:42:26.722423 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d583d57c-8438-41b8-8601-02997298098b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:26.722938 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d583d57c-8438-41b8-8601-02997298098b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:26.729381 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d583d57c-8438-41b8-8601-02997298098b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:26.729859 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d583d57c-8438-41b8-8601-02997298098b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:26.730615 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d583d57c-8438-41b8-8601-02997298098b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:26.731049 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d583d57c-8438-41b8-8601-02997298098b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:26.748921 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:26.866499 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d583d57c-8438-41b8-8601-02997298098b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:26.873949 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d583d57c-8438-41b8-8601-02997298098b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.155570 Aug 01 07:42:26.874511 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 341/699] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:26 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:27.895461 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3740f920-c666-493a-acb8-a54a98695a9a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:27.895992 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3740f920-c666-493a-acb8-a54a98695a9a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:27.902522 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3740f920-c666-493a-acb8-a54a98695a9a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:27.902970 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3740f920-c666-493a-acb8-a54a98695a9a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:27.903774 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3740f920-c666-493a-acb8-a54a98695a9a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:27.904212 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3740f920-c666-493a-acb8-a54a98695a9a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:28.036283 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3740f920-c666-493a-acb8-a54a98695a9a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:28.043730 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3740f920-c666-493a-acb8-a54a98695a9a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.152439 Aug 01 07:42:28.044279 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 359/700] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:27 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:29.065949 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d0aa22bf-c82c-4289-83b0-a9d72a545fdd tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:29.066566 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d0aa22bf-c82c-4289-83b0-a9d72a545fdd tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:29.073124 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d0aa22bf-c82c-4289-83b0-a9d72a545fdd tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:29.073583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d0aa22bf-c82c-4289-83b0-a9d72a545fdd tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:29.074349 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d0aa22bf-c82c-4289-83b0-a9d72a545fdd tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:29.074794 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d0aa22bf-c82c-4289-83b0-a9d72a545fdd tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:29.204017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d0aa22bf-c82c-4289-83b0-a9d72a545fdd tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:29.212075 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d0aa22bf-c82c-4289-83b0-a9d72a545fdd tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.150256 Aug 01 07:42:29.212638 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 342/701] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:29 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:30.233776 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-788e6621-d203-4318-9e86-d88b169ebe1a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:30.234383 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-788e6621-d203-4318-9e86-d88b169ebe1a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:30.241372 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-788e6621-d203-4318-9e86-d88b169ebe1a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:30.241815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-788e6621-d203-4318-9e86-d88b169ebe1a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:30.242561 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-788e6621-d203-4318-9e86-d88b169ebe1a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:30.242991 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-788e6621-d203-4318-9e86-d88b169ebe1a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:30.380582 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-788e6621-d203-4318-9e86-d88b169ebe1a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:30.388354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-788e6621-d203-4318-9e86-d88b169ebe1a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.158353 Aug 01 07:42:30.388912 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 360/702] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:30 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:31.089770 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e71f7208-5382-450f-92b7-ff6d7dcbc021 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:31.091942 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e71f7208-5382-450f-92b7-ff6d7dcbc021 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:31.098384 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e71f7208-5382-450f-92b7-ff6d7dcbc021 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:31.098834 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e71f7208-5382-450f-92b7-ff6d7dcbc021 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:31.099667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e71f7208-5382-450f-92b7-ff6d7dcbc021 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:31.100108 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e71f7208-5382-450f-92b7-ff6d7dcbc021 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:31.128808 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e71f7208-5382-450f-92b7-ff6d7dcbc021 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042436 Aug 01 07:42:31.129352 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 343/703] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:42:31 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 07:42:31.192896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-38466f34-ae68-441a-8b34-f22859120da9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:31.193387 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-38466f34-ae68-441a-8b34-f22859120da9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:31.199483 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-38466f34-ae68-441a-8b34-f22859120da9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:31.199929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-38466f34-ae68-441a-8b34-f22859120da9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:31.200682 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-38466f34-ae68-441a-8b34-f22859120da9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:31.201116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-38466f34-ae68-441a-8b34-f22859120da9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:31.225342 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-38466f34-ae68-441a-8b34-f22859120da9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:42:31.299991 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-38466f34-ae68-441a-8b34-f22859120da9 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "DELETE /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 204 len: 0 microversion: 2.1 time: 0.111102 Aug 01 07:42:31.301160 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 361/704] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:42:31 2022] DELETE /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 07:42:31.309370 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-43fc45ba-c03f-4e26-9cd0-e03e2d6c6a56 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:31.309919 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-43fc45ba-c03f-4e26-9cd0-e03e2d6c6a56 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:31.316677 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-43fc45ba-c03f-4e26-9cd0-e03e2d6c6a56 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:31.317140 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-43fc45ba-c03f-4e26-9cd0-e03e2d6c6a56 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:31.318013 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-43fc45ba-c03f-4e26-9cd0-e03e2d6c6a56 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:31.318463 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-43fc45ba-c03f-4e26-9cd0-e03e2d6c6a56 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:31.409695 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-fd11e24f-106a-474d-aa81-0e1f8e202362 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:31.410398 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-fd11e24f-106a-474d-aa81-0e1f8e202362 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:31.416338 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fd11e24f-106a-474d-aa81-0e1f8e202362 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:31.416792 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fd11e24f-106a-474d-aa81-0e1f8e202362 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:31.417567 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fd11e24f-106a-474d-aa81-0e1f8e202362 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:31.418026 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fd11e24f-106a-474d-aa81-0e1f8e202362 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:31.451246 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-43fc45ba-c03f-4e26-9cd0-e03e2d6c6a56 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:31.459235 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-43fc45ba-c03f-4e26-9cd0-e03e2d6c6a56 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1675 microversion: 2.1 time: 0.153668 Aug 01 07:42:31.464353 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 344/705] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:31 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:31.561471 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fd11e24f-106a-474d-aa81-0e1f8e202362 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:31.570202 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-fd11e24f-106a-474d-aa81-0e1f8e202362 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.164703 Aug 01 07:42:31.570774 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 362/706] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:31 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:31.973578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5ef160d0-4b1c-490f-b8b6-9374780fd1f9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:31.976478 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5ef160d0-4b1c-490f-b8b6-9374780fd1f9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:31.982579 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ef160d0-4b1c-490f-b8b6-9374780fd1f9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:31.983214 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ef160d0-4b1c-490f-b8b6-9374780fd1f9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:31.983865 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ef160d0-4b1c-490f-b8b6-9374780fd1f9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:31.984305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ef160d0-4b1c-490f-b8b6-9374780fd1f9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:32.058594 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5ef160d0-4b1c-490f-b8b6-9374780fd1f9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "POST /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/action" status: 202 len: 0 microversion: 2.1 time: 0.089234 Aug 01 07:42:32.062555 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 345/707] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:42:31 2022] POST /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:42:32.067968 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7e7d25a6-de36-42b7-b060-89178942c578 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:32.068582 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7e7d25a6-de36-42b7-b060-89178942c578 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:32.074583 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7e7d25a6-de36-42b7-b060-89178942c578 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:32.074972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7e7d25a6-de36-42b7-b060-89178942c578 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:32.075778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7e7d25a6-de36-42b7-b060-89178942c578 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:32.076220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7e7d25a6-de36-42b7-b060-89178942c578 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:32.384622 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7e7d25a6-de36-42b7-b060-89178942c578 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:32.392525 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7e7d25a6-de36-42b7-b060-89178942c578 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1753 microversion: 2.1 time: 0.328425 Aug 01 07:42:32.393085 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 363/708] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:32 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1753 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:32.481791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7d6a1778-9639-4a23-9bf0-c65f6a0057de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:32.482488 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7d6a1778-9639-4a23-9bf0-c65f6a0057de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:32.489283 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7d6a1778-9639-4a23-9bf0-c65f6a0057de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:32.489867 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7d6a1778-9639-4a23-9bf0-c65f6a0057de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:32.490631 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7d6a1778-9639-4a23-9bf0-c65f6a0057de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:32.491089 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7d6a1778-9639-4a23-9bf0-c65f6a0057de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:32.591181 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e7a7123e-d9b3-4413-8349-4e8d74487702 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:32.591830 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e7a7123e-d9b3-4413-8349-4e8d74487702 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:32.597823 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e7a7123e-d9b3-4413-8349-4e8d74487702 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:32.598469 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e7a7123e-d9b3-4413-8349-4e8d74487702 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:32.599452 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e7a7123e-d9b3-4413-8349-4e8d74487702 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:32.599893 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e7a7123e-d9b3-4413-8349-4e8d74487702 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:32.621488 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7d6a1778-9639-4a23-9bf0-c65f6a0057de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:32.630037 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7d6a1778-9639-4a23-9bf0-c65f6a0057de tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1675 microversion: 2.1 time: 0.152438 Aug 01 07:42:32.630993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 346/709] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:32 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:32.734753 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e7a7123e-d9b3-4413-8349-4e8d74487702 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:32.742242 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e7a7123e-d9b3-4413-8349-4e8d74487702 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.154955 Aug 01 07:42:32.742800 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 364/710] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:32 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:33.416613 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6b309be9-39d4-4550-a09e-66b8f5079ea9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:33.417224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6b309be9-39d4-4550-a09e-66b8f5079ea9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:33.423392 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6b309be9-39d4-4550-a09e-66b8f5079ea9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:33.424122 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6b309be9-39d4-4550-a09e-66b8f5079ea9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:33.424901 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6b309be9-39d4-4550-a09e-66b8f5079ea9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:33.425344 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6b309be9-39d4-4550-a09e-66b8f5079ea9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:33.576677 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6b309be9-39d4-4550-a09e-66b8f5079ea9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:33.585898 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6b309be9-39d4-4550-a09e-66b8f5079ea9 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1753 microversion: 2.1 time: 0.173315 Aug 01 07:42:33.586470 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 347/711] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:33 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:33.654610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6b78a859-a4d7-4bf1-b615-9cc4dd5dbdfc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:33.655589 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6b78a859-a4d7-4bf1-b615-9cc4dd5dbdfc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:33.662937 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b78a859-a4d7-4bf1-b615-9cc4dd5dbdfc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:33.663427 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b78a859-a4d7-4bf1-b615-9cc4dd5dbdfc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:33.664196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b78a859-a4d7-4bf1-b615-9cc4dd5dbdfc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:33.664627 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b78a859-a4d7-4bf1-b615-9cc4dd5dbdfc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:33.685561 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:33.763917 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fae70aaa-80bc-4187-983f-f359c38e3fd6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:33.764448 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fae70aaa-80bc-4187-983f-f359c38e3fd6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:33.771752 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fae70aaa-80bc-4187-983f-f359c38e3fd6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:33.772388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fae70aaa-80bc-4187-983f-f359c38e3fd6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:33.773087 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fae70aaa-80bc-4187-983f-f359c38e3fd6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:33.773529 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fae70aaa-80bc-4187-983f-f359c38e3fd6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:33.802926 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6b78a859-a4d7-4bf1-b615-9cc4dd5dbdfc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:33.811219 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6b78a859-a4d7-4bf1-b615-9cc4dd5dbdfc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1675 microversion: 2.1 time: 0.161689 Aug 01 07:42:33.811874 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 365/712] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:33 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:34.074954 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-fae70aaa-80bc-4187-983f-f359c38e3fd6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:34.083881 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fae70aaa-80bc-4187-983f-f359c38e3fd6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.323224 Aug 01 07:42:34.084477 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 348/713] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:33 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:34.615345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-54518902-fb12-4062-8c0d-f120b9ac6059 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:34.617050 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-54518902-fb12-4062-8c0d-f120b9ac6059 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:34.625668 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-54518902-fb12-4062-8c0d-f120b9ac6059 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:34.628650 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-54518902-fb12-4062-8c0d-f120b9ac6059 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:34.632843 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-54518902-fb12-4062-8c0d-f120b9ac6059 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:34.633472 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-54518902-fb12-4062-8c0d-f120b9ac6059 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:34.833913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-518d396e-ae53-4761-8d36-398599df3496 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:34.834701 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-518d396e-ae53-4761-8d36-398599df3496 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:34.841917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-54518902-fb12-4062-8c0d-f120b9ac6059 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:34.848123 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-518d396e-ae53-4761-8d36-398599df3496 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:34.848733 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-518d396e-ae53-4761-8d36-398599df3496 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:34.849766 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-518d396e-ae53-4761-8d36-398599df3496 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:34.850415 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-518d396e-ae53-4761-8d36-398599df3496 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:34.851635 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-54518902-fb12-4062-8c0d-f120b9ac6059 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.244177 Aug 01 07:42:34.852371 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 366/714] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:34 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:34.955017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-518d396e-ae53-4761-8d36-398599df3496 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:34.956505 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-9a4ecd61-6ab9-4069-b01a-798163e30237 req-9b331076-7bbc-4900-be6b-0d23a4106262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48863078-f7de-4370-af9c-4bdba932b5c3", "name": "network-vif-deleted", "tag": "e56c66fd-c11c-4962-a9be-c8b351d26751"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:34.968521 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-518d396e-ae53-4761-8d36-398599df3496 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 200 len: 1607 microversion: 2.1 time: 0.139262 Aug 01 07:42:34.969673 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 349/715] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:34 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 1607 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:34.971758 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-9a4ecd61-6ab9-4069-b01a-798163e30237 req-9b331076-7bbc-4900-be6b-0d23a4106262 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:34.972556 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-9a4ecd61-6ab9-4069-b01a-798163e30237 req-9b331076-7bbc-4900-be6b-0d23a4106262 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:34.986311 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-9a4ecd61-6ab9-4069-b01a-798163e30237 req-9b331076-7bbc-4900-be6b-0d23a4106262 service nova] Creating event network-vif-deleted:e56c66fd-c11c-4962-a9be-c8b351d26751 for instance 48863078-f7de-4370-af9c-4bdba932b5c3 on hv-cinder-73306 Aug 01 07:42:34.993440 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-9a4ecd61-6ab9-4069-b01a-798163e30237 req-9b331076-7bbc-4900-be6b-0d23a4106262 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044506 Aug 01 07:42:34.997804 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 367/716] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:35.105633 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-bda410c3-4408-4523-857b-378a0da76970 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:35.106640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-bda410c3-4408-4523-857b-378a0da76970 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:35.115376 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bda410c3-4408-4523-857b-378a0da76970 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:35.116168 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bda410c3-4408-4523-857b-378a0da76970 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:35.117320 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bda410c3-4408-4523-857b-378a0da76970 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:35.118130 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bda410c3-4408-4523-857b-378a0da76970 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:35.262355 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-bda410c3-4408-4523-857b-378a0da76970 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:35.269935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-bda410c3-4408-4523-857b-378a0da76970 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.168702 Aug 01 07:42:35.270633 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 350/717] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:35 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:35.874140 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-dd6d8c3e-1037-4af4-b333-011ad963dfeb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:35.875467 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-dd6d8c3e-1037-4af4-b333-011ad963dfeb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:35.884079 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd6d8c3e-1037-4af4-b333-011ad963dfeb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:35.885102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd6d8c3e-1037-4af4-b333-011ad963dfeb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:35.886287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd6d8c3e-1037-4af4-b333-011ad963dfeb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:35.886928 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd6d8c3e-1037-4af4-b333-011ad963dfeb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:35.992610 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fe56cdec-2df5-4984-bbb6-41292fb6cc96 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:35.993298 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fe56cdec-2df5-4984-bbb6-41292fb6cc96 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:36.003022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe56cdec-2df5-4984-bbb6-41292fb6cc96 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:36.003908 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe56cdec-2df5-4984-bbb6-41292fb6cc96 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:36.007924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe56cdec-2df5-4984-bbb6-41292fb6cc96 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:36.008872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fe56cdec-2df5-4984-bbb6-41292fb6cc96 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:36.027160 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-fe56cdec-2df5-4984-bbb6-41292fb6cc96 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] HTTP exception thrown: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fe56cdec-2df5-4984-bbb6-41292fb6cc96 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Request method failure captured: Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 HTTP/1.1 Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KsPH5Krst4IxwZx655o6wLhmKg6H_suMMRFGd7Ur8JDjDZGRh439JorXRaAyBwW7a6orRQ2vsVg-oK838JndAuppyx2P2RKFJRQ-cEeu2Y4TRX6Lu4xpMfClFIgD2T46UUERUIZE_DKKnpSRrl2XUKjBTwDyfYg9t-EdAvtBcZ7vY Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:42:36.036183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 5958b9f3a2c4424db419e7b1c667ca92 Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:42:36.037823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '48863078-f7de-4370-af9c-4bdba932b5c3'} Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:42:36.038640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:42:36.040196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:42:36.046608 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fe56cdec-2df5-4984-bbb6-41292fb6cc96 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Returning 404 to user: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:42:36.047856 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fe56cdec-2df5-4984-bbb6-41292fb6cc96 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 404 len: 111 microversion: 2.1 time: 0.061857 Aug 01 07:42:36.049091 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 351/718] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:35 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 07:42:36.059044 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5e559f25-8f88-47cb-a822-4109e5a3e06f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '.version_select at 0x7fd018a48790>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:36.061724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-dd6d8c3e-1037-4af4-b333-011ad963dfeb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:36.071362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-dd6d8c3e-1037-4af4-b333-011ad963dfeb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.201840 Aug 01 07:42:36.072545 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 368/719] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:35 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:36.086257 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5e559f25-8f88-47cb-a822-4109e5a3e06f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399290897" status: 202 len: 0 microversion: 2.1 time: 0.032010 Aug 01 07:42:36.086882 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 352/720] 10.222.0.40 () {58 vars in 1221 bytes} [Mon Aug 1 07:42:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399290897 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 07:42:36.291645 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b2d2b5c0-5508-4455-9a1f-c93f7ab22c89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:36.292581 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b2d2b5c0-5508-4455-9a1f-c93f7ab22c89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:36.299381 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b2d2b5c0-5508-4455-9a1f-c93f7ab22c89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:36.300849 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b2d2b5c0-5508-4455-9a1f-c93f7ab22c89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:36.301928 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b2d2b5c0-5508-4455-9a1f-c93f7ab22c89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:36.302611 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b2d2b5c0-5508-4455-9a1f-c93f7ab22c89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:36.521535 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b2d2b5c0-5508-4455-9a1f-c93f7ab22c89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:36.529213 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b2d2b5c0-5508-4455-9a1f-c93f7ab22c89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.242083 Aug 01 07:42:36.529999 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 369/721] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:36 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:36.805198 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b4acd051-4651-4cbe-bbac-ca2eda457140 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'create', calling method: .version_select at 0x7fd018929790>, body: {"keypair": {"name": "tempest-keypair-29442714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMep82mjkzaK4mDp6DoL50Hs7D5W9Q4TPBTvioWyv9LYWVZToQuwieJQNFo91WrgR/GGvu5HZkY/nr3ypon0wQ9NHIKuxK70Ahwppw/et8FUbynxWpa8OUHUbZZd1fd+Nw=="}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:36.821273 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-b4acd051-4651-4cbe-bbac-ca2eda457140 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Getting quotas for project 311edf4e3e534746bed2ff3a2888434d. Resources: {'key_pairs'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:42:36.825108 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-b4acd051-4651-4cbe-bbac-ca2eda457140 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Getting quotas for user 5958b9f3a2c4424db419e7b1c667ca92 and project 311edf4e3e534746bed2ff3a2888434d. Resources: {'key_pairs'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:42:36.847031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b4acd051-4651-4cbe-bbac-ca2eda457140 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.046087 Aug 01 07:42:36.848308 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 353/722] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 1 07:42:36 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:37.094302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-24623081-ae5d-456e-bb17-759ea8c68854 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:37.095605 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-24623081-ae5d-456e-bb17-759ea8c68854 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:37.102927 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-24623081-ae5d-456e-bb17-759ea8c68854 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:37.103469 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-24623081-ae5d-456e-bb17-759ea8c68854 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:37.104429 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-24623081-ae5d-456e-bb17-759ea8c68854 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:37.105032 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-24623081-ae5d-456e-bb17-759ea8c68854 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:37.319573 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-24623081-ae5d-456e-bb17-759ea8c68854 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:37.327876 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-24623081-ae5d-456e-bb17-759ea8c68854 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.237447 Aug 01 07:42:37.328641 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 370/723] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:37 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:37.551487 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ac9f2817-dee1-49f3-bf0e-851407a0c916 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:37.552344 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ac9f2817-dee1-49f3-bf0e-851407a0c916 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:37.558313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ac9f2817-dee1-49f3-bf0e-851407a0c916 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:37.558774 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ac9f2817-dee1-49f3-bf0e-851407a0c916 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:37.559575 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ac9f2817-dee1-49f3-bf0e-851407a0c916 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:37.560020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ac9f2817-dee1-49f3-bf0e-851407a0c916 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:37.696407 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ac9f2817-dee1-49f3-bf0e-851407a0c916 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:37.703927 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ac9f2817-dee1-49f3-bf0e-851407a0c916 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.157567 Aug 01 07:42:37.704497 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 354/724] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:37 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:38.179294 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-136474977", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be198857-00fd-444b-ab8f-c786d2d86330"}], "security_groups": [{"name": "tempest-securitygroup--373077227"}], "key_name": "tempest-keypair-29442714", "user_data": "}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:38.281095 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.network.neutron [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] validate_networks() for [('be198857-00fd-444b-ab8f-c786d2d86330', None, None, None, None, None)] {{(pid=124279) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:42:38.353237 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7c7140a7-f5ad-4084-a2dd-be5c2cbeae55 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:38.353972 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7c7140a7-f5ad-4084-a2dd-be5c2cbeae55 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:38.360033 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c7140a7-f5ad-4084-a2dd-be5c2cbeae55 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:38.360487 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c7140a7-f5ad-4084-a2dd-be5c2cbeae55 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:38.361310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c7140a7-f5ad-4084-a2dd-be5c2cbeae55 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:38.361812 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c7140a7-f5ad-4084-a2dd-be5c2cbeae55 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:38.510539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7c7140a7-f5ad-4084-a2dd-be5c2cbeae55 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:38.518627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7c7140a7-f5ad-4084-a2dd-be5c2cbeae55 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.170675 Aug 01 07:42:38.519308 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 355/725] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:38 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:38.695962 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Flavor limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:42:38.696384 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Image limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:42:38.696851 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Flavor pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:42:38.697276 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Image pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:42:38.697666 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:42:38.706297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:38.706736 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:38.708284 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:38.708719 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:38.725509 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e9a1e6de-c8d0-47d0-8c66-9a79770c85b6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:38.726111 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Getting quotas for project 311edf4e3e534746bed2ff3a2888434d. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:42:38.726225 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e9a1e6de-c8d0-47d0-8c66-9a79770c85b6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:38.729203 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:38.730433 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Getting quotas for user 5958b9f3a2c4424db419e7b1c667ca92 and project 311edf4e3e534746bed2ff3a2888434d. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:42:38.734219 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e9a1e6de-c8d0-47d0-8c66-9a79770c85b6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:38.734573 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e9a1e6de-c8d0-47d0-8c66-9a79770c85b6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:38.735397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e9a1e6de-c8d0-47d0-8c66-9a79770c85b6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:38.735837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e9a1e6de-c8d0-47d0-8c66-9a79770c85b6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:38.743166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Going to run 1 instances... {{(pid=124279) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:42:38.745430 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:42:38.795483 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-af36d88a-39b2-4b1e-b333-7684cf49780c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.620478 Aug 01 07:42:38.796343 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 371/726] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:42:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:42:38.807206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c34c3521-12f4-4287-947d-d20757977252 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:38.807838 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c34c3521-12f4-4287-947d-d20757977252 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:38.877503 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c34c3521-12f4-4287-947d-d20757977252 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:38.887821 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c34c3521-12f4-4287-947d-d20757977252 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1235 microversion: 2.1 time: 0.083706 Aug 01 07:42:38.889466 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 372/727] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:38 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:39.135466 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e9a1e6de-c8d0-47d0-8c66-9a79770c85b6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:39.142862 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e9a1e6de-c8d0-47d0-8c66-9a79770c85b6 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.421366 Aug 01 07:42:39.143457 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 356/728] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:38 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:39.541138 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3f649c9f-996e-4c50-8652-44b1ba987b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:39.541775 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3f649c9f-996e-4c50-8652-44b1ba987b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:39.553663 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f649c9f-996e-4c50-8652-44b1ba987b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:39.554473 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f649c9f-996e-4c50-8652-44b1ba987b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:39.555906 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f649c9f-996e-4c50-8652-44b1ba987b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:39.556521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f649c9f-996e-4c50-8652-44b1ba987b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:39.703640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3f649c9f-996e-4c50-8652-44b1ba987b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:39.712708 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3f649c9f-996e-4c50-8652-44b1ba987b1b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.175579 Aug 01 07:42:39.713277 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 373/729] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:39 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:39.909204 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b582933d-d5e6-48db-b9c3-28c352892a01 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:39.909769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b582933d-d5e6-48db-b9c3-28c352892a01 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:39.917222 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b582933d-d5e6-48db-b9c3-28c352892a01 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:39.917676 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b582933d-d5e6-48db-b9c3-28c352892a01 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:39.918442 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b582933d-d5e6-48db-b9c3-28c352892a01 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:39.918882 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b582933d-d5e6-48db-b9c3-28c352892a01 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:39.980080 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b582933d-d5e6-48db-b9c3-28c352892a01 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:39.987342 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b582933d-d5e6-48db-b9c3-28c352892a01 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1239 microversion: 2.1 time: 0.082054 Aug 01 07:42:39.987903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 357/730] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:39 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:40.165462 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-02096108-8cce-4b8b-9664-7dfd49f1b1de tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:40.166073 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-02096108-8cce-4b8b-9664-7dfd49f1b1de tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:40.173083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-02096108-8cce-4b8b-9664-7dfd49f1b1de tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:40.173536 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-02096108-8cce-4b8b-9664-7dfd49f1b1de tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:40.174302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-02096108-8cce-4b8b-9664-7dfd49f1b1de tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:40.174736 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-02096108-8cce-4b8b-9664-7dfd49f1b1de tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:40.305122 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-02096108-8cce-4b8b-9664-7dfd49f1b1de tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:40.313001 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-02096108-8cce-4b8b-9664-7dfd49f1b1de tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.151313 Aug 01 07:42:40.313557 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 374/731] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:40 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:40.734065 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-72727ced-f515-491a-bd31-3de18faf2ff2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:40.734673 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-72727ced-f515-491a-bd31-3de18faf2ff2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:40.741435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-72727ced-f515-491a-bd31-3de18faf2ff2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:40.741883 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-72727ced-f515-491a-bd31-3de18faf2ff2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:40.742732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-72727ced-f515-491a-bd31-3de18faf2ff2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:40.743106 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-72727ced-f515-491a-bd31-3de18faf2ff2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:40.888330 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-72727ced-f515-491a-bd31-3de18faf2ff2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:40.897976 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-72727ced-f515-491a-bd31-3de18faf2ff2 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.167727 Aug 01 07:42:40.898962 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 358/732] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:40 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:41.008153 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-179d2c0a-5fa7-41a7-9f45-121007642e68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:41.008770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-179d2c0a-5fa7-41a7-9f45-121007642e68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:41.015416 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-179d2c0a-5fa7-41a7-9f45-121007642e68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:41.015879 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-179d2c0a-5fa7-41a7-9f45-121007642e68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:41.016680 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-179d2c0a-5fa7-41a7-9f45-121007642e68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:41.017129 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-179d2c0a-5fa7-41a7-9f45-121007642e68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:41.080082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-179d2c0a-5fa7-41a7-9f45-121007642e68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:41.087673 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-179d2c0a-5fa7-41a7-9f45-121007642e68 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1287 microversion: 2.1 time: 0.083558 Aug 01 07:42:41.088231 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 375/733] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:41 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:41.335401 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7a31cc1e-a6bc-49cd-88c9-f2af64dd930b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:41.336078 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7a31cc1e-a6bc-49cd-88c9-f2af64dd930b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:41.343930 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7a31cc1e-a6bc-49cd-88c9-f2af64dd930b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:41.344379 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7a31cc1e-a6bc-49cd-88c9-f2af64dd930b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:41.345146 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7a31cc1e-a6bc-49cd-88c9-f2af64dd930b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:41.345583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7a31cc1e-a6bc-49cd-88c9-f2af64dd930b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:41.547870 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7a31cc1e-a6bc-49cd-88c9-f2af64dd930b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:41.551585 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:41.556463 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7a31cc1e-a6bc-49cd-88c9-f2af64dd930b tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.225931 Aug 01 07:42:41.558504 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 359/734] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:41 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:41.920824 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4ed9d7df-436a-4150-8f2c-ca54e24170fb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:41.921469 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4ed9d7df-436a-4150-8f2c-ca54e24170fb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:41.928933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4ed9d7df-436a-4150-8f2c-ca54e24170fb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:41.929389 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4ed9d7df-436a-4150-8f2c-ca54e24170fb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:41.930242 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4ed9d7df-436a-4150-8f2c-ca54e24170fb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:41.930669 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4ed9d7df-436a-4150-8f2c-ca54e24170fb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:42.092562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4ed9d7df-436a-4150-8f2c-ca54e24170fb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:42.101196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4ed9d7df-436a-4150-8f2c-ca54e24170fb tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.184195 Aug 01 07:42:42.101996 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 376/735] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:41 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:42.120056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-57fcfe83-5419-46c5-8b8e-6f777a3fe27d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:42.120670 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-57fcfe83-5419-46c5-8b8e-6f777a3fe27d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:42.128523 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-57fcfe83-5419-46c5-8b8e-6f777a3fe27d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:42.129626 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-57fcfe83-5419-46c5-8b8e-6f777a3fe27d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:42.130441 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-57fcfe83-5419-46c5-8b8e-6f777a3fe27d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:42.130886 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-57fcfe83-5419-46c5-8b8e-6f777a3fe27d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:42.204188 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-57fcfe83-5419-46c5-8b8e-6f777a3fe27d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:42.211740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-57fcfe83-5419-46c5-8b8e-6f777a3fe27d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1293 microversion: 2.1 time: 0.095468 Aug 01 07:42:42.212550 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 360/736] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:42 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:42.586306 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1d9c9c4b-6d7c-4ef4-854f-cf2ddfb140f5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:42.587034 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1d9c9c4b-6d7c-4ef4-854f-cf2ddfb140f5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:42.593402 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d9c9c4b-6d7c-4ef4-854f-cf2ddfb140f5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:42.593973 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d9c9c4b-6d7c-4ef4-854f-cf2ddfb140f5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:42.594747 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d9c9c4b-6d7c-4ef4-854f-cf2ddfb140f5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:42.595226 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1d9c9c4b-6d7c-4ef4-854f-cf2ddfb140f5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:42.733835 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1d9c9c4b-6d7c-4ef4-854f-cf2ddfb140f5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:42.756290 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1d9c9c4b-6d7c-4ef4-854f-cf2ddfb140f5 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1509 microversion: 2.1 time: 0.174084 Aug 01 07:42:42.758472 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 377/737] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:42 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:42.778276 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8c565f8b-6c85-4efe-b6ac-c9876071b924 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:42.778887 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8c565f8b-6c85-4efe-b6ac-c9876071b924 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:42.786091 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8c565f8b-6c85-4efe-b6ac-c9876071b924 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:42.786538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8c565f8b-6c85-4efe-b6ac-c9876071b924 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:42.787550 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8c565f8b-6c85-4efe-b6ac-c9876071b924 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:42.787983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8c565f8b-6c85-4efe-b6ac-c9876071b924 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:42.819103 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8c565f8b-6c85-4efe-b6ac-c9876071b924 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124280) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 07:42:42.887638 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8c565f8b-6c85-4efe-b6ac-c9876071b924 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "POST /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e/action" status: 202 len: 0 microversion: 2.1 time: 0.112866 Aug 01 07:42:42.888293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 361/738] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:42:42 2022] POST /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:42:42.897868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6b93a03f-7061-4e34-a6c0-8b0d4b840cf9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:42.898492 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6b93a03f-7061-4e34-a6c0-8b0d4b840cf9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:42.909316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b93a03f-7061-4e34-a6c0-8b0d4b840cf9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:42.910382 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b93a03f-7061-4e34-a6c0-8b0d4b840cf9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:42.911771 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b93a03f-7061-4e34-a6c0-8b0d4b840cf9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:42.912445 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6b93a03f-7061-4e34-a6c0-8b0d4b840cf9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:43.074628 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6b93a03f-7061-4e34-a6c0-8b0d4b840cf9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:43.085230 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6b93a03f-7061-4e34-a6c0-8b0d4b840cf9 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1517 microversion: 2.1 time: 0.192489 Aug 01 07:42:43.085806 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 378/739] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:42 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:43.121649 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a2fe8de1-a00e-4b44-a09f-b7b1f2aac5f8 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:43.122259 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a2fe8de1-a00e-4b44-a09f-b7b1f2aac5f8 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:43.128945 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a2fe8de1-a00e-4b44-a09f-b7b1f2aac5f8 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:43.130093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a2fe8de1-a00e-4b44-a09f-b7b1f2aac5f8 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:43.130875 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a2fe8de1-a00e-4b44-a09f-b7b1f2aac5f8 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:43.131346 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a2fe8de1-a00e-4b44-a09f-b7b1f2aac5f8 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:43.218831 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-45e5c758-21ca-4823-a5e4-eb349efb2ee9 req-8d7ef1d2-51c2-466f-ab6a-f6c0d0a24b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da493896-a5f9-4d76-95d6-52a82e82993e", "tag": "8bf11c7c-0778-4b1e-85f5-92cc79efe14d"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:43.237360 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-45e5c758-21ca-4823-a5e4-eb349efb2ee9 req-8d7ef1d2-51c2-466f-ab6a-f6c0d0a24b0f service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:43.237668 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-45e5c758-21ca-4823-a5e4-eb349efb2ee9 req-8d7ef1d2-51c2-466f-ab6a-f6c0d0a24b0f service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:43.266093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-45e5c758-21ca-4823-a5e4-eb349efb2ee9 req-8d7ef1d2-51c2-466f-ab6a-f6c0d0a24b0f service nova] Creating event network-changed:8bf11c7c-0778-4b1e-85f5-92cc79efe14d for instance da493896-a5f9-4d76-95d6-52a82e82993e on hv-cinder-73306 Aug 01 07:42:43.273231 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-45e5c758-21ca-4823-a5e4-eb349efb2ee9 req-8d7ef1d2-51c2-466f-ab6a-f6c0d0a24b0f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058589 Aug 01 07:42:43.274244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 379/740] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:42:43.279794 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-faffb40f-cdad-4acd-b58b-25a8d773e712 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:43.280589 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-faffb40f-cdad-4acd-b58b-25a8d773e712 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:43.287846 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-faffb40f-cdad-4acd-b58b-25a8d773e712 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:43.288514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-faffb40f-cdad-4acd-b58b-25a8d773e712 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:43.289405 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-faffb40f-cdad-4acd-b58b-25a8d773e712 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:43.290046 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-faffb40f-cdad-4acd-b58b-25a8d773e712 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:43.441669 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a2fe8de1-a00e-4b44-a09f-b7b1f2aac5f8 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:43.455277 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a2fe8de1-a00e-4b44-a09f-b7b1f2aac5f8 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.333383 Aug 01 07:42:43.456421 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 362/741] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:43 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:43.493737 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-faffb40f-cdad-4acd-b58b-25a8d773e712 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:43.502754 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-faffb40f-cdad-4acd-b58b-25a8d773e712 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1360 microversion: 2.1 time: 0.227108 Aug 01 07:42:43.515560 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 380/742] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:43 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1360 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:44.105477 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-372cc32e-d97c-4ba0-b75c-f9503d472b8c tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:44.106138 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-372cc32e-d97c-4ba0-b75c-f9503d472b8c tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:44.112550 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-372cc32e-d97c-4ba0-b75c-f9503d472b8c tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:44.113527 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-372cc32e-d97c-4ba0-b75c-f9503d472b8c tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:44.114301 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-372cc32e-d97c-4ba0-b75c-f9503d472b8c tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:44.114739 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-372cc32e-d97c-4ba0-b75c-f9503d472b8c tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:44.252834 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-372cc32e-d97c-4ba0-b75c-f9503d472b8c tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:44.261027 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-372cc32e-d97c-4ba0-b75c-f9503d472b8c tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1519 microversion: 2.1 time: 0.159374 Aug 01 07:42:44.261597 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 363/743] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:44 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:44.477304 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2ef33b4e-3123-4e46-b59b-c091318a7d4e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:44.477843 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2ef33b4e-3123-4e46-b59b-c091318a7d4e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:44.484326 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2ef33b4e-3123-4e46-b59b-c091318a7d4e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:44.484778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2ef33b4e-3123-4e46-b59b-c091318a7d4e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:44.485539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2ef33b4e-3123-4e46-b59b-c091318a7d4e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:44.485977 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2ef33b4e-3123-4e46-b59b-c091318a7d4e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:44.523897 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ae1f37d6-08ff-484b-9010-fd3990f98280 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:44.524497 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ae1f37d6-08ff-484b-9010-fd3990f98280 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:44.530591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ae1f37d6-08ff-484b-9010-fd3990f98280 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:44.531024 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ae1f37d6-08ff-484b-9010-fd3990f98280 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:44.531818 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ae1f37d6-08ff-484b-9010-fd3990f98280 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:44.532251 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ae1f37d6-08ff-484b-9010-fd3990f98280 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:44.628679 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2ef33b4e-3123-4e46-b59b-c091318a7d4e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:44.636782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2ef33b4e-3123-4e46-b59b-c091318a7d4e tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.163367 Aug 01 07:42:44.637347 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 381/744] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:44 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:44.663251 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ae1f37d6-08ff-484b-9010-fd3990f98280 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:44.670507 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ae1f37d6-08ff-484b-9010-fd3990f98280 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1360 microversion: 2.1 time: 0.150529 Aug 01 07:42:44.671090 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 364/745] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:44 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:45.282096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-89a1e788-b194-47f9-abca-9c9e47aa403a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:45.282727 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-89a1e788-b194-47f9-abca-9c9e47aa403a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:45.283768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-c8d7c4a7-3c3d-42eb-8e7c-c73e2aa7faf5 req-9bb6fa08-4bb4-4ef5-8608-581898f7aeae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b28df3b-0e7f-425f-9e11-c2e34a32f31e", "name": "network-vif-unplugged", "status": "completed", "tag": "8385f662-a544-477f-910d-b785d83e699e"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:45.289767 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-89a1e788-b194-47f9-abca-9c9e47aa403a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:45.290227 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-89a1e788-b194-47f9-abca-9c9e47aa403a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:45.291010 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-89a1e788-b194-47f9-abca-9c9e47aa403a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:45.291723 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-89a1e788-b194-47f9-abca-9c9e47aa403a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:45.297198 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-c8d7c4a7-3c3d-42eb-8e7c-c73e2aa7faf5 req-9bb6fa08-4bb4-4ef5-8608-581898f7aeae service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:45.298770 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-c8d7c4a7-3c3d-42eb-8e7c-c73e2aa7faf5 req-9bb6fa08-4bb4-4ef5-8608-581898f7aeae service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:45.313791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.compute.server_external_events [req-c8d7c4a7-3c3d-42eb-8e7c-c73e2aa7faf5 req-9bb6fa08-4bb4-4ef5-8608-581898f7aeae service nova] Unable to find a host for instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e. Dropping event network-vif-unplugged {{(pid=124280) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 07:42:45.314775 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-c8d7c4a7-3c3d-42eb-8e7c-c73e2aa7faf5 req-9bb6fa08-4bb4-4ef5-8608-581898f7aeae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034890 Aug 01 07:42:45.315570 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 365/746] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 01 07:42:45.451633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-89a1e788-b194-47f9-abca-9c9e47aa403a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:45.459781 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-89a1e788-b194-47f9-abca-9c9e47aa403a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1519 microversion: 2.1 time: 0.181557 Aug 01 07:42:45.460351 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 382/747] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:45 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:45.658969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-78c02cc3-ef9c-4db3-827b-4319f9e341af tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:45.660118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-78c02cc3-ef9c-4db3-827b-4319f9e341af tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:45.666212 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78c02cc3-ef9c-4db3-827b-4319f9e341af tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:45.666674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78c02cc3-ef9c-4db3-827b-4319f9e341af tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:45.667493 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78c02cc3-ef9c-4db3-827b-4319f9e341af tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:45.667939 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78c02cc3-ef9c-4db3-827b-4319f9e341af tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:45.692781 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-146a44f5-3ba9-4295-8dff-13af956400a4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:45.693797 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-146a44f5-3ba9-4295-8dff-13af956400a4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:45.700655 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-146a44f5-3ba9-4295-8dff-13af956400a4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:45.701244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-146a44f5-3ba9-4295-8dff-13af956400a4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:45.702230 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-146a44f5-3ba9-4295-8dff-13af956400a4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:45.702760 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-146a44f5-3ba9-4295-8dff-13af956400a4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:45.827270 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-78c02cc3-ef9c-4db3-827b-4319f9e341af tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:45.835208 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-78c02cc3-ef9c-4db3-827b-4319f9e341af tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.180938 Aug 01 07:42:45.835783 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 366/748] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:45 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:45.840868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-146a44f5-3ba9-4295-8dff-13af956400a4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:45.848397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-146a44f5-3ba9-4295-8dff-13af956400a4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1360 microversion: 2.1 time: 0.160088 Aug 01 07:42:45.849230 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 383/749] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:45 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:46.480723 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6616af5f-2e15-4698-a114-64249a30edfe tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:46.481258 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6616af5f-2e15-4698-a114-64249a30edfe tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:46.487826 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6616af5f-2e15-4698-a114-64249a30edfe tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:46.488155 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6616af5f-2e15-4698-a114-64249a30edfe tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:46.488937 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6616af5f-2e15-4698-a114-64249a30edfe tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:46.489376 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6616af5f-2e15-4698-a114-64249a30edfe tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:46.674838 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6616af5f-2e15-4698-a114-64249a30edfe tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:46.682558 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6616af5f-2e15-4698-a114-64249a30edfe tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.205761 Aug 01 07:42:46.683176 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 367/750] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:46 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:46.856630 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-074684ce-93f8-4e30-b734-03ee29a782a3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:46.857173 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-074684ce-93f8-4e30-b734-03ee29a782a3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:46.863964 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-074684ce-93f8-4e30-b734-03ee29a782a3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:46.864421 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-074684ce-93f8-4e30-b734-03ee29a782a3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:46.865190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-074684ce-93f8-4e30-b734-03ee29a782a3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:46.865744 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-074684ce-93f8-4e30-b734-03ee29a782a3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:46.868870 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6f0ee2ec-1fb4-41c4-9737-20d5fd969988 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:46.869549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6f0ee2ec-1fb4-41c4-9737-20d5fd969988 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:46.871344 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=4 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:46.877103 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6f0ee2ec-1fb4-41c4-9737-20d5fd969988 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:46.877556 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6f0ee2ec-1fb4-41c4-9737-20d5fd969988 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:46.878815 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6f0ee2ec-1fb4-41c4-9737-20d5fd969988 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:46.879354 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6f0ee2ec-1fb4-41c4-9737-20d5fd969988 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:47.012398 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-074684ce-93f8-4e30-b734-03ee29a782a3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:47.013506 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6f0ee2ec-1fb4-41c4-9737-20d5fd969988 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:47.020980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6f0ee2ec-1fb4-41c4-9737-20d5fd969988 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1360 microversion: 2.1 time: 0.155838 Aug 01 07:42:47.021153 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-074684ce-93f8-4e30-b734-03ee29a782a3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.168382 Aug 01 07:42:47.021626 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 384/751] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:46 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:47.022620 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 368/752] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:46 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:47.703885 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0288ca66-003a-4638-a878-ecc552273764 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:47.704584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0288ca66-003a-4638-a878-ecc552273764 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:47.712065 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0288ca66-003a-4638-a878-ecc552273764 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:47.712506 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0288ca66-003a-4638-a878-ecc552273764 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:47.713578 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0288ca66-003a-4638-a878-ecc552273764 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:47.714025 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0288ca66-003a-4638-a878-ecc552273764 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:47.718350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=100 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:47.854987 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0288ca66-003a-4638-a878-ecc552273764 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:47.863980 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0288ca66-003a-4638-a878-ecc552273764 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.163863 Aug 01 07:42:47.864626 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 385/753] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:47 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:48.041307 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c4313a53-b53e-44fd-9ed5-76a0dc179761 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:48.041945 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c4313a53-b53e-44fd-9ed5-76a0dc179761 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:48.042190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-dff5304e-b3c0-490b-8caf-d7f504c7a707 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:48.042860 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-dff5304e-b3c0-490b-8caf-d7f504c7a707 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:48.048788 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c4313a53-b53e-44fd-9ed5-76a0dc179761 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:48.049240 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c4313a53-b53e-44fd-9ed5-76a0dc179761 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:48.049358 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dff5304e-b3c0-490b-8caf-d7f504c7a707 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:48.049714 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dff5304e-b3c0-490b-8caf-d7f504c7a707 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:48.050526 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c4313a53-b53e-44fd-9ed5-76a0dc179761 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:48.051002 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c4313a53-b53e-44fd-9ed5-76a0dc179761 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:48.051151 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dff5304e-b3c0-490b-8caf-d7f504c7a707 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:48.051520 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dff5304e-b3c0-490b-8caf-d7f504c7a707 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:48.181366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c4313a53-b53e-44fd-9ed5-76a0dc179761 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:48.188865 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c4313a53-b53e-44fd-9ed5-76a0dc179761 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1360 microversion: 2.1 time: 0.151380 Aug 01 07:42:48.189440 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 369/754] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:48 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:48.194266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-dff5304e-b3c0-490b-8caf-d7f504c7a707 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:48.202250 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-dff5304e-b3c0-490b-8caf-d7f504c7a707 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.163873 Aug 01 07:42:48.202820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 386/755] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:48 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:42:48.886220 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a4860bdc-60ae-479d-8f0a-75941c65f63f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:48.886822 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a4860bdc-60ae-479d-8f0a-75941c65f63f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:48.892851 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a4860bdc-60ae-479d-8f0a-75941c65f63f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:48.893306 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a4860bdc-60ae-479d-8f0a-75941c65f63f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:48.894193 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a4860bdc-60ae-479d-8f0a-75941c65f63f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:48.894640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a4860bdc-60ae-479d-8f0a-75941c65f63f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:49.023480 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a4860bdc-60ae-479d-8f0a-75941c65f63f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:49.030895 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a4860bdc-60ae-479d-8f0a-75941c65f63f tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.148591 Aug 01 07:42:49.031498 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 370/756] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:48 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:49.209910 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-429cbea5-6333-4d81-b9c1-8946f83aa0c3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:49.210515 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-429cbea5-6333-4d81-b9c1-8946f83aa0c3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:49.212381 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:49.213580 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=8 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:49.221320 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-429cbea5-6333-4d81-b9c1-8946f83aa0c3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:49.222493 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-429cbea5-6333-4d81-b9c1-8946f83aa0c3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:49.224043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-429cbea5-6333-4d81-b9c1-8946f83aa0c3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:49.224525 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-429cbea5-6333-4d81-b9c1-8946f83aa0c3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:49.225326 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-bee8ce27-904a-49f5-80ac-89f1c7ec2220 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:49.226040 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-bee8ce27-904a-49f5-80ac-89f1c7ec2220 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:49.232858 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bee8ce27-904a-49f5-80ac-89f1c7ec2220 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:49.233371 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bee8ce27-904a-49f5-80ac-89f1c7ec2220 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:49.234258 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bee8ce27-904a-49f5-80ac-89f1c7ec2220 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:49.234835 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bee8ce27-904a-49f5-80ac-89f1c7ec2220 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:49.378823 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-429cbea5-6333-4d81-b9c1-8946f83aa0c3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:49.387022 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-429cbea5-6333-4d81-b9c1-8946f83aa0c3 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1360 microversion: 2.1 time: 0.181016 Aug 01 07:42:49.396954 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 387/757] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:49 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:49.402021 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-3068b52b-c0fe-4161-b0a4-df794cf8444d req-502e4f3b-4eb8-4fbc-9e7f-929b28a9206f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da493896-a5f9-4d76-95d6-52a82e82993e", "name": "network-vif-plugged", "status": "completed", "tag": "8bf11c7c-0778-4b1e-85f5-92cc79efe14d"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:49.407364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-bee8ce27-904a-49f5-80ac-89f1c7ec2220 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:49.413102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-3068b52b-c0fe-4161-b0a4-df794cf8444d req-502e4f3b-4eb8-4fbc-9e7f-929b28a9206f service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:49.413550 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-3068b52b-c0fe-4161-b0a4-df794cf8444d req-502e4f3b-4eb8-4fbc-9e7f-929b28a9206f service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:49.416494 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-bee8ce27-904a-49f5-80ac-89f1c7ec2220 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.196266 Aug 01 07:42:49.424930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-3068b52b-c0fe-4161-b0a4-df794cf8444d req-502e4f3b-4eb8-4fbc-9e7f-929b28a9206f service nova] Creating event network-vif-plugged:8bf11c7c-0778-4b1e-85f5-92cc79efe14d for instance da493896-a5f9-4d76-95d6-52a82e82993e on hv-cinder-73306 Aug 01 07:42:49.430445 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 371/758] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:49 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:49.431772 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-3068b52b-c0fe-4161-b0a4-df794cf8444d req-502e4f3b-4eb8-4fbc-9e7f-929b28a9206f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042177 Aug 01 07:42:49.432362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 388/759] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:50.051861 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1cf9adec-bdf2-47af-9172-efb656197432 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:50.052478 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1cf9adec-bdf2-47af-9172-efb656197432 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:50.058453 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1cf9adec-bdf2-47af-9172-efb656197432 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:50.058908 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1cf9adec-bdf2-47af-9172-efb656197432 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:50.059718 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1cf9adec-bdf2-47af-9172-efb656197432 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:50.060157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1cf9adec-bdf2-47af-9172-efb656197432 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:50.202201 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1cf9adec-bdf2-47af-9172-efb656197432 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:50.211987 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1cf9adec-bdf2-47af-9172-efb656197432 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.163975 Aug 01 07:42:50.212572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 372/760] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:50 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:50.411177 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bc7f5011-0c61-49a1-ae3e-1248c960d18c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:50.412114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-bc7f5011-0c61-49a1-ae3e-1248c960d18c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:50.414637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:50.420205 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bc7f5011-0c61-49a1-ae3e-1248c960d18c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:50.420656 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bc7f5011-0c61-49a1-ae3e-1248c960d18c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:50.421425 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bc7f5011-0c61-49a1-ae3e-1248c960d18c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:50.421856 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bc7f5011-0c61-49a1-ae3e-1248c960d18c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:50.437564 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a29a8499-50f0-4788-89ce-13da8676566c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:50.438384 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a29a8499-50f0-4788-89ce-13da8676566c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:50.447035 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a29a8499-50f0-4788-89ce-13da8676566c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:50.447661 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a29a8499-50f0-4788-89ce-13da8676566c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:50.448582 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a29a8499-50f0-4788-89ce-13da8676566c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:50.449124 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a29a8499-50f0-4788-89ce-13da8676566c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:50.594318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a29a8499-50f0-4788-89ce-13da8676566c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:50.602946 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a29a8499-50f0-4788-89ce-13da8676566c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1758 microversion: 2.1 time: 0.169156 Aug 01 07:42:50.603738 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 373/761] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:50 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:50.610083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bc7f5011-0c61-49a1-ae3e-1248c960d18c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:50.625187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-bc7f5011-0c61-49a1-ae3e-1248c960d18c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1360 microversion: 2.1 time: 0.218441 Aug 01 07:42:50.625765 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 389/762] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:50 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1360 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:51.233719 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-631857af-b298-4731-a4f7-f6902a2bfa89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:51.234247 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-631857af-b298-4731-a4f7-f6902a2bfa89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:51.241263 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-631857af-b298-4731-a4f7-f6902a2bfa89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:51.241716 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-631857af-b298-4731-a4f7-f6902a2bfa89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:51.242476 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-631857af-b298-4731-a4f7-f6902a2bfa89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:51.242938 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-631857af-b298-4731-a4f7-f6902a2bfa89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:51.373174 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-631857af-b298-4731-a4f7-f6902a2bfa89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:51.380877 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-631857af-b298-4731-a4f7-f6902a2bfa89 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.151170 Aug 01 07:42:51.381442 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 374/763] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:51 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:51.626029 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f21a036a-0942-4dff-b2bc-f4f61d6480be tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:51.626889 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f21a036a-0942-4dff-b2bc-f4f61d6480be tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:51.633841 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f21a036a-0942-4dff-b2bc-f4f61d6480be tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:51.634364 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f21a036a-0942-4dff-b2bc-f4f61d6480be tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:51.635149 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f21a036a-0942-4dff-b2bc-f4f61d6480be tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:51.635579 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f21a036a-0942-4dff-b2bc-f4f61d6480be tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:51.647976 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-18e90c6b-c1ce-400f-bc1f-0d686504674a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:51.648742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-18e90c6b-c1ce-400f-bc1f-0d686504674a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:51.655188 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-18e90c6b-c1ce-400f-bc1f-0d686504674a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:51.655641 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-18e90c6b-c1ce-400f-bc1f-0d686504674a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:51.656437 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-18e90c6b-c1ce-400f-bc1f-0d686504674a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:51.656870 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-18e90c6b-c1ce-400f-bc1f-0d686504674a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:51.791702 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-18e90c6b-c1ce-400f-bc1f-0d686504674a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:51.798996 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-18e90c6b-c1ce-400f-bc1f-0d686504674a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1546 microversion: 2.1 time: 0.156028 Aug 01 07:42:51.799598 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 375/764] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:51 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:51.800245 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f21a036a-0942-4dff-b2bc-f4f61d6480be tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:51.808526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f21a036a-0942-4dff-b2bc-f4f61d6480be tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1761 microversion: 2.1 time: 0.186245 Aug 01 07:42:51.809093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 390/765] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:51 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1761 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:51.819343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e6af218c-6de5-4cad-8da5-8664161498f0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:51.819872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e6af218c-6de5-4cad-8da5-8664161498f0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:51.826245 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e6af218c-6de5-4cad-8da5-8664161498f0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:51.826705 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e6af218c-6de5-4cad-8da5-8664161498f0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:51.827510 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e6af218c-6de5-4cad-8da5-8664161498f0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:51.827953 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e6af218c-6de5-4cad-8da5-8664161498f0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:51.833197 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:42:51.905718 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e6af218c-6de5-4cad-8da5-8664161498f0 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090569 Aug 01 07:42:51.906310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 376/766] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 1 07:42:51 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:52.401559 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-639019df-615b-4122-803b-398095b4eeca tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:52.402175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-639019df-615b-4122-803b-398095b4eeca tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:52.408296 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-639019df-615b-4122-803b-398095b4eeca tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:52.408759 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-639019df-615b-4122-803b-398095b4eeca tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:52.409670 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-639019df-615b-4122-803b-398095b4eeca tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:52.410278 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-639019df-615b-4122-803b-398095b4eeca tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:52.545227 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-639019df-615b-4122-803b-398095b4eeca tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:52.553387 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-639019df-615b-4122-803b-398095b4eeca tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.155660 Aug 01 07:42:52.553961 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 391/767] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:52 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:53.249114 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-0b6c6d51-25a2-4d67-8408-ca2c2f6d0b5b req-140a220d-166e-47b7-8181-77268c95442e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da493896-a5f9-4d76-95d6-52a82e82993e", "tag": "8bf11c7c-0778-4b1e-85f5-92cc79efe14d"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:53.259889 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-0b6c6d51-25a2-4d67-8408-ca2c2f6d0b5b req-140a220d-166e-47b7-8181-77268c95442e service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:53.260365 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-0b6c6d51-25a2-4d67-8408-ca2c2f6d0b5b req-140a220d-166e-47b7-8181-77268c95442e service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:53.273553 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-0b6c6d51-25a2-4d67-8408-ca2c2f6d0b5b req-140a220d-166e-47b7-8181-77268c95442e service nova] Creating event network-changed:8bf11c7c-0778-4b1e-85f5-92cc79efe14d for instance da493896-a5f9-4d76-95d6-52a82e82993e on hv-cinder-73306 Aug 01 07:42:53.278459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-0b6c6d51-25a2-4d67-8408-ca2c2f6d0b5b req-140a220d-166e-47b7-8181-77268c95442e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211077 Aug 01 07:42:53.279102 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 377/768] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:53.574592 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-85f23ff8-1d4c-4bec-9f89-77d2c9e54e29 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:53.575231 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-85f23ff8-1d4c-4bec-9f89-77d2c9e54e29 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:53.583098 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-85f23ff8-1d4c-4bec-9f89-77d2c9e54e29 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:53.583550 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-85f23ff8-1d4c-4bec-9f89-77d2c9e54e29 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:53.584317 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-85f23ff8-1d4c-4bec-9f89-77d2c9e54e29 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:53.584937 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-85f23ff8-1d4c-4bec-9f89-77d2c9e54e29 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:53.740322 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-85f23ff8-1d4c-4bec-9f89-77d2c9e54e29 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:53.748189 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-85f23ff8-1d4c-4bec-9f89-77d2c9e54e29 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.177355 Aug 01 07:42:53.748775 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 392/769] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:53 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:54.773662 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9443c883-1639-45cd-ba5c-7d2576b3a66e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:54.774286 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9443c883-1639-45cd-ba5c-7d2576b3a66e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:54.780657 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9443c883-1639-45cd-ba5c-7d2576b3a66e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:54.781112 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9443c883-1639-45cd-ba5c-7d2576b3a66e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:54.781877 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9443c883-1639-45cd-ba5c-7d2576b3a66e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:54.782318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9443c883-1639-45cd-ba5c-7d2576b3a66e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:54.912178 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9443c883-1639-45cd-ba5c-7d2576b3a66e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:54.919719 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9443c883-1639-45cd-ba5c-7d2576b3a66e tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.151601 Aug 01 07:42:54.920305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 378/770] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:54 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:55.942313 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d1260b08-c15e-4efb-9352-6047766d69fc tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:55.942923 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d1260b08-c15e-4efb-9352-6047766d69fc tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:55.949495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d1260b08-c15e-4efb-9352-6047766d69fc tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:55.949956 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d1260b08-c15e-4efb-9352-6047766d69fc tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:55.950726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d1260b08-c15e-4efb-9352-6047766d69fc tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:55.951192 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d1260b08-c15e-4efb-9352-6047766d69fc tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:56.082276 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d1260b08-c15e-4efb-9352-6047766d69fc tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:56.089816 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d1260b08-c15e-4efb-9352-6047766d69fc tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.152159 Aug 01 07:42:56.090376 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 393/771] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:55 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:57.111263 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-15fc6595-5854-4753-afb8-9921e4b40ece tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:57.111907 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-15fc6595-5854-4753-afb8-9921e4b40ece tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:57.119225 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-15fc6595-5854-4753-afb8-9921e4b40ece tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:57.119682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-15fc6595-5854-4753-afb8-9921e4b40ece tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:57.120445 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-15fc6595-5854-4753-afb8-9921e4b40ece tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:57.120887 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-15fc6595-5854-4753-afb8-9921e4b40ece tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:57.255724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-15fc6595-5854-4753-afb8-9921e4b40ece tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:57.263712 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-15fc6595-5854-4753-afb8-9921e4b40ece tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.156311 Aug 01 07:42:57.264300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 379/772] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:57 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:57.377042 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-574e1888-f097-467c-bb52-87c1264cc3fd req-647ee25d-7200-48d5-a0b1-d492266cb064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b28df3b-0e7f-425f-9e11-c2e34a32f31e", "name": "network-vif-plugged", "status": "completed", "tag": "8385f662-a544-477f-910d-b785d83e699e"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:42:57.388805 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-574e1888-f097-467c-bb52-87c1264cc3fd req-647ee25d-7200-48d5-a0b1-d492266cb064 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:57.389256 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-574e1888-f097-467c-bb52-87c1264cc3fd req-647ee25d-7200-48d5-a0b1-d492266cb064 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:57.401074 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-574e1888-f097-467c-bb52-87c1264cc3fd req-647ee25d-7200-48d5-a0b1-d492266cb064 service nova] Creating event network-vif-plugged:8385f662-a544-477f-910d-b785d83e699e for instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e on hv-cinder-73306 Aug 01 07:42:57.406099 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-574e1888-f097-467c-bb52-87c1264cc3fd req-647ee25d-7200-48d5-a0b1-d492266cb064 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032984 Aug 01 07:42:57.406678 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 394/773] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:42:58.284426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4271fd1b-57b8-43c5-8b09-47eed4a6247a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:58.284966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4271fd1b-57b8-43c5-8b09-47eed4a6247a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:58.291558 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4271fd1b-57b8-43c5-8b09-47eed4a6247a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:58.292014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4271fd1b-57b8-43c5-8b09-47eed4a6247a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:58.292776 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4271fd1b-57b8-43c5-8b09-47eed4a6247a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:58.293217 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4271fd1b-57b8-43c5-8b09-47eed4a6247a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:58.426275 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-4271fd1b-57b8-43c5-8b09-47eed4a6247a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:58.433747 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4271fd1b-57b8-43c5-8b09-47eed4a6247a tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1575 microversion: 2.1 time: 0.153258 Aug 01 07:42:58.434302 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 380/774] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:58 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:42:59.455648 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d69c8ddf-7da3-4973-ab9c-adf8e4dab9d4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:42:59.456342 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d69c8ddf-7da3-4973-ab9c-adf8e4dab9d4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:42:59.464020 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d69c8ddf-7da3-4973-ab9c-adf8e4dab9d4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:59.464466 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d69c8ddf-7da3-4973-ab9c-adf8e4dab9d4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:59.465379 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d69c8ddf-7da3-4973-ab9c-adf8e4dab9d4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:42:59.465813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d69c8ddf-7da3-4973-ab9c-adf8e4dab9d4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:42:59.605877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d69c8ddf-7da3-4973-ab9c-adf8e4dab9d4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:42:59.613982 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d69c8ddf-7da3-4973-ab9c-adf8e4dab9d4 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1562 microversion: 2.1 time: 0.162104 Aug 01 07:42:59.614533 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 395/775] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:42:59 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:03.813784 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2535856c-200b-47fd-aeda-6256cfdf2a59 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:03.814301 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2535856c-200b-47fd-aeda-6256cfdf2a59 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:03.820952 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2535856c-200b-47fd-aeda-6256cfdf2a59 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:03.821404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2535856c-200b-47fd-aeda-6256cfdf2a59 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:03.822163 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2535856c-200b-47fd-aeda-6256cfdf2a59 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:03.822604 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2535856c-200b-47fd-aeda-6256cfdf2a59 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:03.904229 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-2535856c-200b-47fd-aeda-6256cfdf2a59 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lazy-loading 'services' on Instance uuid 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:43:03.974839 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2535856c-200b-47fd-aeda-6256cfdf2a59 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "DELETE /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments/c284000c-5005-49f6-91fe-6ca78aa4b59f" status: 202 len: 0 microversion: 2.1 time: 0.164694 Aug 01 07:43:03.975570 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 381/776] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:43:03 2022] DELETE /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments/c284000c-5005-49f6-91fe-6ca78aa4b59f => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:43:03.984903 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-db8a64af-3f8e-46df-b2ce-6b50fc52bbde tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:03.987100 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-db8a64af-3f8e-46df-b2ce-6b50fc52bbde tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:03.993884 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-db8a64af-3f8e-46df-b2ce-6b50fc52bbde tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:03.994521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-db8a64af-3f8e-46df-b2ce-6b50fc52bbde tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:03.995404 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-db8a64af-3f8e-46df-b2ce-6b50fc52bbde tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:03.995923 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-db8a64af-3f8e-46df-b2ce-6b50fc52bbde tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:04.030538 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-db8a64af-3f8e-46df-b2ce-6b50fc52bbde tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050380 Aug 01 07:43:04.031118 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 396/777] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:43:03 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:05.043759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6314e78e-cb22-412c-9a4d-bcf2e6ad7aba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:05.046060 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6314e78e-cb22-412c-9a4d-bcf2e6ad7aba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:05.053089 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6314e78e-cb22-412c-9a4d-bcf2e6ad7aba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:05.053536 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6314e78e-cb22-412c-9a4d-bcf2e6ad7aba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:05.054300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6314e78e-cb22-412c-9a4d-bcf2e6ad7aba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:05.054732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6314e78e-cb22-412c-9a4d-bcf2e6ad7aba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:05.082734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6314e78e-cb22-412c-9a4d-bcf2e6ad7aba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043803 Aug 01 07:43:05.083310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 382/778] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:43:05 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 07:43:05.160632 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2003723e-06c1-4dd5-a8dc-7a2bd6af980b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:05.161160 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2003723e-06c1-4dd5-a8dc-7a2bd6af980b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:05.167681 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2003723e-06c1-4dd5-a8dc-7a2bd6af980b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:05.168134 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2003723e-06c1-4dd5-a8dc-7a2bd6af980b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:05.168896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2003723e-06c1-4dd5-a8dc-7a2bd6af980b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:05.169333 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2003723e-06c1-4dd5-a8dc-7a2bd6af980b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:05.193624 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2003723e-06c1-4dd5-a8dc-7a2bd6af980b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:43:05.267150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2003723e-06c1-4dd5-a8dc-7a2bd6af980b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "DELETE /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 204 len: 0 microversion: 2.1 time: 0.110653 Aug 01 07:43:05.267694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 397/779] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:43:05 2022] DELETE /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:43:05.276155 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-753632cd-9132-4155-911b-4a6a9f1a5ae2 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:05.276759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-753632cd-9132-4155-911b-4a6a9f1a5ae2 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:05.282919 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-753632cd-9132-4155-911b-4a6a9f1a5ae2 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:05.283659 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-753632cd-9132-4155-911b-4a6a9f1a5ae2 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:05.284423 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-753632cd-9132-4155-911b-4a6a9f1a5ae2 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:05.285490 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-753632cd-9132-4155-911b-4a6a9f1a5ae2 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:05.413849 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-753632cd-9132-4155-911b-4a6a9f1a5ae2 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:05.421277 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-753632cd-9132-4155-911b-4a6a9f1a5ae2 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1687 microversion: 2.1 time: 0.148907 Aug 01 07:43:05.421838 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 383/780] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:05 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:06.442216 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d00facf0-dfd8-48ce-b906-d1a07e6327ba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:06.442742 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d00facf0-dfd8-48ce-b906-d1a07e6327ba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:06.449575 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d00facf0-dfd8-48ce-b906-d1a07e6327ba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:06.450034 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d00facf0-dfd8-48ce-b906-d1a07e6327ba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:06.450846 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d00facf0-dfd8-48ce-b906-d1a07e6327ba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:06.451338 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d00facf0-dfd8-48ce-b906-d1a07e6327ba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:06.525894 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0fa83be3-a041-4885-97b8-7d30634b2165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:06.526483 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0fa83be3-a041-4885-97b8-7d30634b2165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:06.532470 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0fa83be3-a041-4885-97b8-7d30634b2165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:06.532925 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0fa83be3-a041-4885-97b8-7d30634b2165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:06.533697 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0fa83be3-a041-4885-97b8-7d30634b2165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:06.534140 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0fa83be3-a041-4885-97b8-7d30634b2165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:06.559383 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0fa83be3-a041-4885-97b8-7d30634b2165 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/ips" status: 200 len: 151 microversion: 2.20 time: 0.148025 Aug 01 07:43:06.559942 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 398/781] 10.222.0.40 () {60 vars in 1289 bytes} [Mon Aug 1 07:43:06 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/ips => generated 151 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:43:06.584949 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d00facf0-dfd8-48ce-b906-d1a07e6327ba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:06.592453 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d00facf0-dfd8-48ce-b906-d1a07e6327ba tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1687 microversion: 2.1 time: 0.154727 Aug 01 07:43:06.593019 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 384/782] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:06 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:07.614135 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2824e6a3-30f5-4794-9e0c-367aff7a6d1a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:07.614739 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2824e6a3-30f5-4794-9e0c-367aff7a6d1a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:07.621169 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2824e6a3-30f5-4794-9e0c-367aff7a6d1a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:07.621618 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2824e6a3-30f5-4794-9e0c-367aff7a6d1a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:07.622371 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2824e6a3-30f5-4794-9e0c-367aff7a6d1a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:07.622804 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2824e6a3-30f5-4794-9e0c-367aff7a6d1a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:07.752203 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2824e6a3-30f5-4794-9e0c-367aff7a6d1a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:07.760911 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2824e6a3-30f5-4794-9e0c-367aff7a6d1a tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1687 microversion: 2.1 time: 0.150806 Aug 01 07:43:07.761476 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 399/783] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:07 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:08.717082 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-55cecf69-951f-420b-b30b-b25fb21fd005 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:08.717655 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-55cecf69-951f-420b-b30b-b25fb21fd005 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:08.724769 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-55cecf69-951f-420b-b30b-b25fb21fd005 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:08.725212 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-55cecf69-951f-420b-b30b-b25fb21fd005 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:08.726015 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-55cecf69-951f-420b-b30b-b25fb21fd005 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:08.726428 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-55cecf69-951f-420b-b30b-b25fb21fd005 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:08.748638 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-55cecf69-951f-420b-b30b-b25fb21fd005 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lazy-loading 'flavor' on Instance uuid 0f30f324-1dcf-44b9-b81d-ef96811b0a87 {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:43:08.781719 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-496baae7-3930-41b0-8b4a-80d1db38ea2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:08.782326 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-496baae7-3930-41b0-8b4a-80d1db38ea2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:08.789213 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-496baae7-3930-41b0-8b4a-80d1db38ea2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:08.789663 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-496baae7-3930-41b0-8b4a-80d1db38ea2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:08.790442 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-496baae7-3930-41b0-8b4a-80d1db38ea2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:08.790859 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-496baae7-3930-41b0-8b4a-80d1db38ea2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:08.921879 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-496baae7-3930-41b0-8b4a-80d1db38ea2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:08.926235 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-55cecf69-951f-420b-b30b-b25fb21fd005 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "POST /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/action" status: 202 len: 0 microversion: 2.20 time: 0.212286 Aug 01 07:43:08.926983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 385/784] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Aug 1 07:43:08 2022] POST /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:43:08.930270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-496baae7-3930-41b0-8b4a-80d1db38ea2b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1687 microversion: 2.1 time: 0.152281 Aug 01 07:43:08.930821 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 400/785] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:08 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:08.935454 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-67224e83-b049-446b-992c-e0d5028dfcdf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:08.936230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-67224e83-b049-446b-992c-e0d5028dfcdf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:08.938189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:08.944811 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-67224e83-b049-446b-992c-e0d5028dfcdf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:08.945272 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-67224e83-b049-446b-992c-e0d5028dfcdf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:08.946060 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-67224e83-b049-446b-992c-e0d5028dfcdf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:08.946508 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-67224e83-b049-446b-992c-e0d5028dfcdf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:09.085251 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-67224e83-b049-446b-992c-e0d5028dfcdf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:09.093266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-67224e83-b049-446b-992c-e0d5028dfcdf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:09.094774 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-67224e83-b049-446b-992c-e0d5028dfcdf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:09.095959 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-67224e83-b049-446b-992c-e0d5028dfcdf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.164718 Aug 01 07:43:09.096524 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 386/786] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:08 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:43:09.952703 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d25b57bd-47ab-494d-b5a2-852498f60d46 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:09.953337 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d25b57bd-47ab-494d-b5a2-852498f60d46 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:09.960404 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d25b57bd-47ab-494d-b5a2-852498f60d46 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:09.960855 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d25b57bd-47ab-494d-b5a2-852498f60d46 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:09.961625 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d25b57bd-47ab-494d-b5a2-852498f60d46 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:09.962059 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d25b57bd-47ab-494d-b5a2-852498f60d46 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:10.033756 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d25b57bd-47ab-494d-b5a2-852498f60d46 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:10.040508 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:10.043087 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d25b57bd-47ab-494d-b5a2-852498f60d46 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 200 len: 1620 microversion: 2.1 time: 0.094173 Aug 01 07:43:10.043853 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 401/787] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:09 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 1620 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:10.077732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-a2fa8008-0a73-4ff7-8852-70453e71c55f req-838272b2-eb37-432f-bfb7-481ee5daea47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d", "name": "network-vif-deleted", "tag": "62003bcf-02f7-4b14-97e3-6fad5084dd62"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:10.100172 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-a2fa8008-0a73-4ff7-8852-70453e71c55f req-838272b2-eb37-432f-bfb7-481ee5daea47 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:10.101047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-a2fa8008-0a73-4ff7-8852-70453e71c55f req-838272b2-eb37-432f-bfb7-481ee5daea47 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:10.112265 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-a2fa8008-0a73-4ff7-8852-70453e71c55f req-838272b2-eb37-432f-bfb7-481ee5daea47 service nova] Creating event network-vif-deleted:62003bcf-02f7-4b14-97e3-6fad5084dd62 for instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d on hv-cinder-73306 Aug 01 07:43:10.118054 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-a2fa8008-0a73-4ff7-8852-70453e71c55f req-838272b2-eb37-432f-bfb7-481ee5daea47 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044908 Aug 01 07:43:10.118812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-eb27f965-caff-4073-9584-c1d8c33966a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:10.119087 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 387/788] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:10.119486 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-eb27f965-caff-4073-9584-c1d8c33966a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:10.132281 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-eb27f965-caff-4073-9584-c1d8c33966a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:10.133060 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-eb27f965-caff-4073-9584-c1d8c33966a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:10.133886 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-eb27f965-caff-4073-9584-c1d8c33966a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:10.134497 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-eb27f965-caff-4073-9584-c1d8c33966a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:10.303331 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-eb27f965-caff-4073-9584-c1d8c33966a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:10.314281 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-eb27f965-caff-4073-9584-c1d8c33966a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:10.315894 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-eb27f965-caff-4073-9584-c1d8c33966a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:10.317042 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-eb27f965-caff-4073-9584-c1d8c33966a3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.202443 Aug 01 07:43:10.317808 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 402/789] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:10 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:11.065028 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7c735332-99f4-45b0-a600-c334e96982f8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:11.066181 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7c735332-99f4-45b0-a600-c334e96982f8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:11.072812 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c735332-99f4-45b0-a600-c334e96982f8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:11.073309 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c735332-99f4-45b0-a600-c334e96982f8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:11.074099 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c735332-99f4-45b0-a600-c334e96982f8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:11.074528 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7c735332-99f4-45b0-a600-c334e96982f8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:11.089355 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-7c735332-99f4-45b0-a600-c334e96982f8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] HTTP exception thrown: Instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d could not be found. Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7c735332-99f4-45b0-a600-c334e96982f8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Request method failure captured: Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d HTTP/1.1 Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54Kyn7fgIOOlVQOe_iFzrxEhB5ZYfzP1N8kO7rOTuHfs3DHd50pdfNgKj05xoWbt8QDwaQiYV_jIV6PjClEExJj62j4pbOtwtSh24VBb1HaRP4_5Y1KFfIh0Ovn_SXpns93svbDb6A4SjUYl1K4CRkFTtLkXpwu2IlYTEfOiQxSjxW0 Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 015cc91d3e2f4d3791301c05e4c8be20 Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:43:11.091009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 015cc91d3e2f4d3791301c05e4c8be20 Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-ServerRescueNegativeTestJSON-86514510-project Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: db6ac4cf9dd84e338f944b4905dcdb50 Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-ServerRescueNegativeTestJSON-86514510-project Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d could not be found. Aug 01 07:43:11.092495 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d'} Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d could not be found. Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:43:11.093317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d could not be found. Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d could not be found. Aug 01 07:43:11.094966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:11.096603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7c735332-99f4-45b0-a600-c334e96982f8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Returning 404 to user: Instance 13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:43:11.096603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7c735332-99f4-45b0-a600-c334e96982f8 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d" status: 404 len: 111 microversion: 2.1 time: 0.031938 Aug 01 07:43:11.096603 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 388/790] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:11 2022] GET /compute/v2.1/servers/13c7005d-9d18-4bd3-8ec7-91e4f2f8ae5d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:43:11.101353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-77dd20d1-599c-4096-98a2-313b143cf21d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '.version_select at 0x7fd0188de4c0>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:11.120909 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-77dd20d1-599c-4096-98a2-313b143cf21d tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273085578" status: 202 len: 0 microversion: 2.1 time: 0.023329 Aug 01 07:43:11.121470 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 403/791] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Aug 1 07:43:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273085578 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:43:11.341741 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5e1b040d-09a4-4841-8807-1339fda1835b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:11.342272 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5e1b040d-09a4-4841-8807-1339fda1835b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:11.349089 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5e1b040d-09a4-4841-8807-1339fda1835b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:11.349538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5e1b040d-09a4-4841-8807-1339fda1835b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:11.350334 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5e1b040d-09a4-4841-8807-1339fda1835b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:11.350803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5e1b040d-09a4-4841-8807-1339fda1835b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:11.486190 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5e1b040d-09a4-4841-8807-1339fda1835b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:11.495471 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5e1b040d-09a4-4841-8807-1339fda1835b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:11.496988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5e1b040d-09a4-4841-8807-1339fda1835b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:11.498139 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5e1b040d-09a4-4841-8807-1339fda1835b tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.160458 Aug 01 07:43:11.498693 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 389/792] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:11 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:43:12.522838 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1b3aaee2-8090-4165-a978-1b0142249262 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:12.523380 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1b3aaee2-8090-4165-a978-1b0142249262 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:12.529504 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b3aaee2-8090-4165-a978-1b0142249262 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:12.529960 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b3aaee2-8090-4165-a978-1b0142249262 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:12.530736 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b3aaee2-8090-4165-a978-1b0142249262 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:12.531211 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b3aaee2-8090-4165-a978-1b0142249262 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:12.661222 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1b3aaee2-8090-4165-a978-1b0142249262 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:12.670250 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1b3aaee2-8090-4165-a978-1b0142249262 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:12.671782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1b3aaee2-8090-4165-a978-1b0142249262 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:12.672975 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1b3aaee2-8090-4165-a978-1b0142249262 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.154752 Aug 01 07:43:12.673528 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 404/793] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:12 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:13.696461 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2eea4930-f139-4e7e-b6d3-69d271d5cb04 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:13.697054 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2eea4930-f139-4e7e-b6d3-69d271d5cb04 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:13.703692 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2eea4930-f139-4e7e-b6d3-69d271d5cb04 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:13.704151 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2eea4930-f139-4e7e-b6d3-69d271d5cb04 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:13.704919 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2eea4930-f139-4e7e-b6d3-69d271d5cb04 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:13.705362 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2eea4930-f139-4e7e-b6d3-69d271d5cb04 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:13.842011 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2eea4930-f139-4e7e-b6d3-69d271d5cb04 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:13.850541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2eea4930-f139-4e7e-b6d3-69d271d5cb04 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:13.852074 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2eea4930-f139-4e7e-b6d3-69d271d5cb04 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:13.853226 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2eea4930-f139-4e7e-b6d3-69d271d5cb04 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.160688 Aug 01 07:43:13.853783 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 390/794] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:13 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:14.205127 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3c6ef147-2305-4f63-b292-bf152c794b13 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:14.205626 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3c6ef147-2305-4f63-b292-bf152c794b13 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:14.212583 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3c6ef147-2305-4f63-b292-bf152c794b13 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:14.213036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3c6ef147-2305-4f63-b292-bf152c794b13 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:14.213802 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3c6ef147-2305-4f63-b292-bf152c794b13 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:14.214240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3c6ef147-2305-4f63-b292-bf152c794b13 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:14.238917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3c6ef147-2305-4f63-b292-bf152c794b13 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:43:14.312573 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3c6ef147-2305-4f63-b292-bf152c794b13 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "DELETE /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 204 len: 0 microversion: 2.1 time: 0.110857 Aug 01 07:43:14.313161 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 405/795] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:43:14 2022] DELETE /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:43:14.322903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b11b1700-7e7e-4a97-a350-e5325a69e7b0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:14.323543 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b11b1700-7e7e-4a97-a350-e5325a69e7b0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:14.329582 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b11b1700-7e7e-4a97-a350-e5325a69e7b0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:14.330037 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b11b1700-7e7e-4a97-a350-e5325a69e7b0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:14.330802 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b11b1700-7e7e-4a97-a350-e5325a69e7b0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:14.331830 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b11b1700-7e7e-4a97-a350-e5325a69e7b0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:14.461484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b11b1700-7e7e-4a97-a350-e5325a69e7b0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:14.468909 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b11b1700-7e7e-4a97-a350-e5325a69e7b0 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1507 microversion: 2.1 time: 0.151065 Aug 01 07:43:14.469475 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 391/796] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:14 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:14.879382 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ce2eeebe-d556-4bc7-ad95-536d03353adc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:14.880070 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ce2eeebe-d556-4bc7-ad95-536d03353adc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:14.885961 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ce2eeebe-d556-4bc7-ad95-536d03353adc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:14.886409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ce2eeebe-d556-4bc7-ad95-536d03353adc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:14.887190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ce2eeebe-d556-4bc7-ad95-536d03353adc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:14.887625 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ce2eeebe-d556-4bc7-ad95-536d03353adc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:15.015911 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ce2eeebe-d556-4bc7-ad95-536d03353adc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:15.023886 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ce2eeebe-d556-4bc7-ad95-536d03353adc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:15.025374 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ce2eeebe-d556-4bc7-ad95-536d03353adc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:15.026519 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ce2eeebe-d556-4bc7-ad95-536d03353adc tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.152705 Aug 01 07:43:15.027079 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 406/797] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:14 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:43:15.492084 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f7d0be5a-7f15-4f83-9344-a73f792e83a6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:15.492802 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f7d0be5a-7f15-4f83-9344-a73f792e83a6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:15.499398 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f7d0be5a-7f15-4f83-9344-a73f792e83a6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:15.499852 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f7d0be5a-7f15-4f83-9344-a73f792e83a6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:15.500615 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f7d0be5a-7f15-4f83-9344-a73f792e83a6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:15.501308 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f7d0be5a-7f15-4f83-9344-a73f792e83a6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:15.519619 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:15.636521 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f7d0be5a-7f15-4f83-9344-a73f792e83a6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:15.644283 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f7d0be5a-7f15-4f83-9344-a73f792e83a6 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1507 microversion: 2.1 time: 0.156822 Aug 01 07:43:15.644888 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 392/798] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:15 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:16.049396 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-008277dc-16e9-4a8e-97ed-c547f60e75e3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:16.050851 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-008277dc-16e9-4a8e-97ed-c547f60e75e3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:16.057106 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-008277dc-16e9-4a8e-97ed-c547f60e75e3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:16.057553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-008277dc-16e9-4a8e-97ed-c547f60e75e3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:16.058333 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-008277dc-16e9-4a8e-97ed-c547f60e75e3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:16.058751 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-008277dc-16e9-4a8e-97ed-c547f60e75e3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:16.180396 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-63c04dae-f2da-49be-a17c-7df2447bfea4 req-f6b063dc-e987-40e8-be11-bbc79959cc3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451a7361-81eb-4f1b-be18-1f144f037202", "name": "network-vif-deleted", "tag": "50575a60-bea2-40e1-a490-a7dc71582936"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:16.196137 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-63c04dae-f2da-49be-a17c-7df2447bfea4 req-f6b063dc-e987-40e8-be11-bbc79959cc3c service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:16.197591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-63c04dae-f2da-49be-a17c-7df2447bfea4 req-f6b063dc-e987-40e8-be11-bbc79959cc3c service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:16.214462 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-63c04dae-f2da-49be-a17c-7df2447bfea4 req-f6b063dc-e987-40e8-be11-bbc79959cc3c service nova] Creating event network-vif-deleted:50575a60-bea2-40e1-a490-a7dc71582936 for instance 451a7361-81eb-4f1b-be18-1f144f037202 on hv-cinder-73306 Aug 01 07:43:16.217161 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-008277dc-16e9-4a8e-97ed-c547f60e75e3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:16.221210 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-63c04dae-f2da-49be-a17c-7df2447bfea4 req-f6b063dc-e987-40e8-be11-bbc79959cc3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047674 Aug 01 07:43:16.221706 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 393/799] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:43:16.229108 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-008277dc-16e9-4a8e-97ed-c547f60e75e3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:16.230653 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-008277dc-16e9-4a8e-97ed-c547f60e75e3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:16.231868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-008277dc-16e9-4a8e-97ed-c547f60e75e3 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.186466 Aug 01 07:43:16.232461 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 407/800] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:16 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:16.665243 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:16.666433 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:16.673305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:16.673761 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:16.674532 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:16.675520 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:16.711718 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:16.712065 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:16.712526 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lazy-loading 'fault' on Instance uuid 451a7361-81eb-4f1b-be18-1f144f037202 {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:43:16.758123 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:16.765014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-66c62afd-d39b-4179-8ea5-111ac2dcf170 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 200 len: 1312 microversion: 2.1 time: 0.104117 Aug 01 07:43:16.765583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 394/801] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:16 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:17.255545 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0c281838-f290-4428-9811-0c48bf5c7f93 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:17.256082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0c281838-f290-4428-9811-0c48bf5c7f93 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:17.263001 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0c281838-f290-4428-9811-0c48bf5c7f93 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:17.263679 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0c281838-f290-4428-9811-0c48bf5c7f93 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:17.264733 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0c281838-f290-4428-9811-0c48bf5c7f93 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:17.265363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0c281838-f290-4428-9811-0c48bf5c7f93 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:17.399920 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0c281838-f290-4428-9811-0c48bf5c7f93 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:17.407772 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0c281838-f290-4428-9811-0c48bf5c7f93 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:17.409898 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-0c281838-f290-4428-9811-0c48bf5c7f93 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:17.411049 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0c281838-f290-4428-9811-0c48bf5c7f93 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.161047 Aug 01 07:43:17.411620 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 408/802] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:17 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:17.787660 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4808fd69-0f7f-4942-8a1d-807770a2042b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:17.788274 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-4808fd69-0f7f-4942-8a1d-807770a2042b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 451a7361-81eb-4f1b-be18-1f144f037202] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:17.795198 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4808fd69-0f7f-4942-8a1d-807770a2042b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:17.795654 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4808fd69-0f7f-4942-8a1d-807770a2042b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:17.796418 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4808fd69-0f7f-4942-8a1d-807770a2042b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:17.796859 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-4808fd69-0f7f-4942-8a1d-807770a2042b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:17.811416 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-4808fd69-0f7f-4942-8a1d-807770a2042b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] HTTP exception thrown: Instance 451a7361-81eb-4f1b-be18-1f144f037202 could not be found. Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4808fd69-0f7f-4942-8a1d-807770a2042b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Request method failure captured: Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 HTTP/1.1 Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54Kyn7fgIOOlVQOe_iFzrxEhB5ZYfzP1N8kO7rOTuHfs3DHd50pdfNgKj05xoWbt8QDwaQiYV_jIV6PjClEExJj62j4pbOtwtSh24VBb1HaRP4_5Y1KFfIh0Ovn_SXpns93svbDb6A4SjUYl1K4CRkFTtLkXpwu2IlYTEfOiQxSjxW0 Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 015cc91d3e2f4d3791301c05e4c8be20 Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:43:17.813043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 015cc91d3e2f4d3791301c05e4c8be20 Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-ServerRescueNegativeTestJSON-86514510-project Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: db6ac4cf9dd84e338f944b4905dcdb50 Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-ServerRescueNegativeTestJSON-86514510-project Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 451a7361-81eb-4f1b-be18-1f144f037202 could not be found. Aug 01 07:43:17.814632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '451a7361-81eb-4f1b-be18-1f144f037202'} Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 451a7361-81eb-4f1b-be18-1f144f037202 could not be found. Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:43:17.815629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 451a7361-81eb-4f1b-be18-1f144f037202 could not be found. Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 451a7361-81eb-4f1b-be18-1f144f037202 could not be found. Aug 01 07:43:17.816929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:17.818252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-4808fd69-0f7f-4942-8a1d-807770a2042b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Returning 404 to user: Instance 451a7361-81eb-4f1b-be18-1f144f037202 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:43:17.818252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-4808fd69-0f7f-4942-8a1d-807770a2042b tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202" status: 404 len: 111 microversion: 2.1 time: 0.031808 Aug 01 07:43:17.818252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 395/803] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:17 2022] GET /compute/v2.1/servers/451a7361-81eb-4f1b-be18-1f144f037202 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:43:17.823392 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-182ac926-4df3-4d71-be72-30480d280e32 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:17.823917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-182ac926-4df3-4d71-be72-30480d280e32 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:17.829930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-182ac926-4df3-4d71-be72-30480d280e32 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:17.830377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-182ac926-4df3-4d71-be72-30480d280e32 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:17.831736 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-182ac926-4df3-4d71-be72-30480d280e32 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:17.832194 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-182ac926-4df3-4d71-be72-30480d280e32 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:17.858523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-182ac926-4df3-4d71-be72-30480d280e32 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:43:17.931964 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-182ac926-4df3-4d71-be72-30480d280e32 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "DELETE /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 204 len: 0 microversion: 2.1 time: 0.112095 Aug 01 07:43:17.932677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 409/804] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:43:17 2022] DELETE /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:43:17.941345 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-dae61c3a-b2a9-467c-839a-c1cb18fcff79 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:17.941886 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-dae61c3a-b2a9-467c-839a-c1cb18fcff79 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:17.948310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dae61c3a-b2a9-467c-839a-c1cb18fcff79 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:17.948799 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dae61c3a-b2a9-467c-839a-c1cb18fcff79 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:17.949607 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dae61c3a-b2a9-467c-839a-c1cb18fcff79 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:17.950046 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dae61c3a-b2a9-467c-839a-c1cb18fcff79 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:18.084864 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-dae61c3a-b2a9-467c-839a-c1cb18fcff79 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:18.092428 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-dae61c3a-b2a9-467c-839a-c1cb18fcff79 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.155179 Aug 01 07:43:18.092982 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 396/805] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:17 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:18.434473 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4832f7b6-db06-46f2-8a5f-81427af40b48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:18.435194 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4832f7b6-db06-46f2-8a5f-81427af40b48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:18.441981 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4832f7b6-db06-46f2-8a5f-81427af40b48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:18.442432 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4832f7b6-db06-46f2-8a5f-81427af40b48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:18.443223 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4832f7b6-db06-46f2-8a5f-81427af40b48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:18.443664 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4832f7b6-db06-46f2-8a5f-81427af40b48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:18.571438 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4832f7b6-db06-46f2-8a5f-81427af40b48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:18.579350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4832f7b6-db06-46f2-8a5f-81427af40b48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:18.580859 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4832f7b6-db06-46f2-8a5f-81427af40b48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:18.582563 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4832f7b6-db06-46f2-8a5f-81427af40b48 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.152419 Aug 01 07:43:18.583128 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 410/806] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:18 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:19.114735 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-68f2c1ee-ec02-4db5-a774-ab0d926f0155 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:19.115312 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-68f2c1ee-ec02-4db5-a774-ab0d926f0155 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:19.121874 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-68f2c1ee-ec02-4db5-a774-ab0d926f0155 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:19.122331 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-68f2c1ee-ec02-4db5-a774-ab0d926f0155 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:19.123111 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-68f2c1ee-ec02-4db5-a774-ab0d926f0155 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:19.123559 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-68f2c1ee-ec02-4db5-a774-ab0d926f0155 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:19.251438 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-68f2c1ee-ec02-4db5-a774-ab0d926f0155 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:19.258945 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-68f2c1ee-ec02-4db5-a774-ab0d926f0155 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.149134 Aug 01 07:43:19.259540 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 397/807] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:19 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:19.605931 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-dd6c07c2-4b2e-483c-9a8a-0c8beb05e953 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:19.606539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-dd6c07c2-4b2e-483c-9a8a-0c8beb05e953 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:19.613022 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd6c07c2-4b2e-483c-9a8a-0c8beb05e953 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:19.613608 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd6c07c2-4b2e-483c-9a8a-0c8beb05e953 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:19.614374 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd6c07c2-4b2e-483c-9a8a-0c8beb05e953 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:19.614812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-dd6c07c2-4b2e-483c-9a8a-0c8beb05e953 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:19.745050 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-dd6c07c2-4b2e-483c-9a8a-0c8beb05e953 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:19.753223 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-dd6c07c2-4b2e-483c-9a8a-0c8beb05e953 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:19.755302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-dd6c07c2-4b2e-483c-9a8a-0c8beb05e953 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:19.756757 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-dd6c07c2-4b2e-483c-9a8a-0c8beb05e953 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.154500 Aug 01 07:43:19.757505 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 411/808] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:19 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:20.279626 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-81319d73-1274-440e-ac6d-cb91108a75cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:20.280168 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-81319d73-1274-440e-ac6d-cb91108a75cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:20.286994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-81319d73-1274-440e-ac6d-cb91108a75cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:20.287483 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-81319d73-1274-440e-ac6d-cb91108a75cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:20.288248 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-81319d73-1274-440e-ac6d-cb91108a75cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:20.288686 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-81319d73-1274-440e-ac6d-cb91108a75cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:20.418721 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-81319d73-1274-440e-ac6d-cb91108a75cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:20.426761 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-81319d73-1274-440e-ac6d-cb91108a75cd tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1522 microversion: 2.1 time: 0.151098 Aug 01 07:43:20.427360 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 398/809] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:20 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:20.780355 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d98be0eb-77c5-4039-9ff5-f122dbf40251 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:20.780968 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d98be0eb-77c5-4039-9ff5-f122dbf40251 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:20.783744 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:20.790081 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d98be0eb-77c5-4039-9ff5-f122dbf40251 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:20.790545 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d98be0eb-77c5-4039-9ff5-f122dbf40251 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:20.791379 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d98be0eb-77c5-4039-9ff5-f122dbf40251 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:20.791827 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d98be0eb-77c5-4039-9ff5-f122dbf40251 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:20.945132 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d98be0eb-77c5-4039-9ff5-f122dbf40251 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:20.950466 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-0252304b-b95c-4f9a-96af-b17684d06dd7 req-a59653fd-4252-4178-9fd5-0d7404c50878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ee0c72-d5d4-4b77-a434-b3fbbaeae13e", "name": "network-vif-deleted", "tag": "d5e19417-4c11-464d-a9fa-6ac51f3c5660"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:20.962778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d98be0eb-77c5-4039-9ff5-f122dbf40251 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:20.964717 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d98be0eb-77c5-4039-9ff5-f122dbf40251 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:20.966083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d98be0eb-77c5-4039-9ff5-f122dbf40251 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.189619 Aug 01 07:43:20.967328 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 412/810] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:20 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:20.971517 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-0252304b-b95c-4f9a-96af-b17684d06dd7 req-a59653fd-4252-4178-9fd5-0d7404c50878 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:20.971978 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-0252304b-b95c-4f9a-96af-b17684d06dd7 req-a59653fd-4252-4178-9fd5-0d7404c50878 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:20.984402 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-0252304b-b95c-4f9a-96af-b17684d06dd7 req-a59653fd-4252-4178-9fd5-0d7404c50878 service nova] Creating event network-vif-deleted:d5e19417-4c11-464d-a9fa-6ac51f3c5660 for instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e on hv-cinder-73306 Aug 01 07:43:20.989831 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-0252304b-b95c-4f9a-96af-b17684d06dd7 req-a59653fd-4252-4178-9fd5-0d7404c50878 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042998 Aug 01 07:43:20.990500 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 399/811] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:43:21.447571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:21.448193 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:21.454327 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:21.454784 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:21.455590 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:21.456033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:21.489317 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:21.490257 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:21.490257 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lazy-loading 'fault' on Instance uuid 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:43:21.496377 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fb473e68-433f-4ae0-ac6d-3274b5f067eb tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:21.496954 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fb473e68-433f-4ae0-ac6d-3274b5f067eb tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:21.505601 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb473e68-433f-4ae0-ac6d-3274b5f067eb tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:21.506122 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb473e68-433f-4ae0-ac6d-3274b5f067eb tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:21.507088 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb473e68-433f-4ae0-ac6d-3274b5f067eb tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:21.508113 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb473e68-433f-4ae0-ac6d-3274b5f067eb tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:21.532742 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6ac4cf9dd84e338f944b4905dcdb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cc91d3e2f4d3791301c05e4c8be20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:21.534974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fb473e68-433f-4ae0-ac6d-3274b5f067eb tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Going to try to terminate instance {{(pid=124280) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:43:21.541150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9b87429d-7ef0-41d9-9b41-ebc0d00e75bf tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 200 len: 1312 microversion: 2.1 time: 0.097372 Aug 01 07:43:21.541869 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 413/812] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:21 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:21.620150 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fb473e68-433f-4ae0-ac6d-3274b5f067eb tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 204 len: 0 microversion: 2.1 time: 0.128009 Aug 01 07:43:21.620743 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 400/813] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:43:21 2022] DELETE /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:43:21.629533 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b9ccd5da-2c09-455c-86d0-8044fda10d85 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:21.630261 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b9ccd5da-2c09-455c-86d0-8044fda10d85 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:21.636613 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b9ccd5da-2c09-455c-86d0-8044fda10d85 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:21.637071 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b9ccd5da-2c09-455c-86d0-8044fda10d85 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:21.637837 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b9ccd5da-2c09-455c-86d0-8044fda10d85 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:21.638298 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b9ccd5da-2c09-455c-86d0-8044fda10d85 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:21.774000 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b9ccd5da-2c09-455c-86d0-8044fda10d85 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:21.781443 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b9ccd5da-2c09-455c-86d0-8044fda10d85 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1577 microversion: 2.1 time: 0.156357 Aug 01 07:43:21.782015 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 414/814] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:21 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:21.989764 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-62ac48cf-2d85-4a0c-8118-a9b0adf2a3bf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:21.990459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-62ac48cf-2d85-4a0c-8118-a9b0adf2a3bf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:21.996491 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-62ac48cf-2d85-4a0c-8118-a9b0adf2a3bf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:21.996943 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-62ac48cf-2d85-4a0c-8118-a9b0adf2a3bf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:21.997705 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-62ac48cf-2d85-4a0c-8118-a9b0adf2a3bf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:21.998282 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-62ac48cf-2d85-4a0c-8118-a9b0adf2a3bf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:22.130872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-62ac48cf-2d85-4a0c-8118-a9b0adf2a3bf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:22.138945 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-62ac48cf-2d85-4a0c-8118-a9b0adf2a3bf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:22.140550 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-62ac48cf-2d85-4a0c-8118-a9b0adf2a3bf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:22.141780 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-62ac48cf-2d85-4a0c-8118-a9b0adf2a3bf tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.156262 Aug 01 07:43:22.142342 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 401/815] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:21 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:22.562756 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6475b1d4-06ea-4865-89f5-a82623b5e665 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:22.563428 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6475b1d4-06ea-4865-89f5-a82623b5e665 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] [instance: 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:22.570469 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6475b1d4-06ea-4865-89f5-a82623b5e665 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:22.570927 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6475b1d4-06ea-4865-89f5-a82623b5e665 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:22.571731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6475b1d4-06ea-4865-89f5-a82623b5e665 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:22.572181 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6475b1d4-06ea-4865-89f5-a82623b5e665 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:22.585546 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-6475b1d4-06ea-4865-89f5-a82623b5e665 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] HTTP exception thrown: Instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e could not be found. Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6475b1d4-06ea-4865-89f5-a82623b5e665 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Request method failure captured: Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e HTTP/1.1 Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54Kyn7fgIOOlVQOe_iFzrxEhB5ZYfzP1N8kO7rOTuHfs3DHd50pdfNgKj05xoWbt8QDwaQiYV_jIV6PjClEExJj62j4pbOtwtSh24VBb1HaRP4_5Y1KFfIh0Ovn_SXpns93svbDb6A4SjUYl1K4CRkFTtLkXpwu2IlYTEfOiQxSjxW0 Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 015cc91d3e2f4d3791301c05e4c8be20 Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:43:22.587209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_015cc91d3e2f4d3791301c05e4c8be20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 015cc91d3e2f4d3791301c05e4c8be20 Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-86514510 Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-ServerRescueNegativeTestJSON-86514510-project Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: db6ac4cf9dd84e338f944b4905dcdb50 Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-ServerRescueNegativeTestJSON-86514510-project Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e could not be found. Aug 01 07:43:22.588724 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '61ee0c72-d5d4-4b77-a434-b3fbbaeae13e'} Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e could not be found. Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:43:22.589610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e could not be found. Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e could not be found. Aug 01 07:43:22.591082 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:22.592490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6475b1d4-06ea-4865-89f5-a82623b5e665 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] Returning 404 to user: Instance 61ee0c72-d5d4-4b77-a434-b3fbbaeae13e could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:43:22.592490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6475b1d4-06ea-4865-89f5-a82623b5e665 tempest-ServerRescueNegativeTestJSON-86514510 tempest-ServerRescueNegativeTestJSON-86514510-project] 10.222.0.40 "GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e" status: 404 len: 111 microversion: 2.1 time: 0.029763 Aug 01 07:43:22.592490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 415/816] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:22 2022] GET /compute/v2.1/servers/61ee0c72-d5d4-4b77-a434-b3fbbaeae13e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:43:22.803922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5fda153a-049d-4c05-a3f9-7c050ee5b5d4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:22.804534 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5fda153a-049d-4c05-a3f9-7c050ee5b5d4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:22.811364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5fda153a-049d-4c05-a3f9-7c050ee5b5d4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:22.811819 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5fda153a-049d-4c05-a3f9-7c050ee5b5d4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:22.813491 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5fda153a-049d-4c05-a3f9-7c050ee5b5d4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:22.813882 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5fda153a-049d-4c05-a3f9-7c050ee5b5d4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:22.947468 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5fda153a-049d-4c05-a3f9-7c050ee5b5d4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:22.955166 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5fda153a-049d-4c05-a3f9-7c050ee5b5d4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1577 microversion: 2.1 time: 0.155865 Aug 01 07:43:22.955817 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 402/817] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:22 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:23.166619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3f377491-8ebb-4902-84e5-9012ddfeb934 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:23.167267 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3f377491-8ebb-4902-84e5-9012ddfeb934 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:23.173268 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f377491-8ebb-4902-84e5-9012ddfeb934 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:23.173714 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f377491-8ebb-4902-84e5-9012ddfeb934 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:23.174474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f377491-8ebb-4902-84e5-9012ddfeb934 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:23.174903 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f377491-8ebb-4902-84e5-9012ddfeb934 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:23.193023 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:23.399098 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3f377491-8ebb-4902-84e5-9012ddfeb934 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:23.407020 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3f377491-8ebb-4902-84e5-9012ddfeb934 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:23.408617 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3f377491-8ebb-4902-84e5-9012ddfeb934 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:23.409726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3f377491-8ebb-4902-84e5-9012ddfeb934 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.247163 Aug 01 07:43:23.411439 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 416/818] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:23 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:23.976702 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0d1b97bb-167a-4c7c-860a-22dc7af6d301 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:23.977400 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0d1b97bb-167a-4c7c-860a-22dc7af6d301 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:23.983824 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0d1b97bb-167a-4c7c-860a-22dc7af6d301 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:23.984364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0d1b97bb-167a-4c7c-860a-22dc7af6d301 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:23.985220 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0d1b97bb-167a-4c7c-860a-22dc7af6d301 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:23.985727 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0d1b97bb-167a-4c7c-860a-22dc7af6d301 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:24.204589 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0d1b97bb-167a-4c7c-860a-22dc7af6d301 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:24.213728 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0d1b97bb-167a-4c7c-860a-22dc7af6d301 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1577 microversion: 2.1 time: 0.240750 Aug 01 07:43:24.214310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 403/819] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:23 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1577 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:24.434630 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ab2bfdc4-df4d-4745-8f5b-4193e2efa8cd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:24.435282 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ab2bfdc4-df4d-4745-8f5b-4193e2efa8cd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:24.443229 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ab2bfdc4-df4d-4745-8f5b-4193e2efa8cd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:24.446134 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ab2bfdc4-df4d-4745-8f5b-4193e2efa8cd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:24.447260 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ab2bfdc4-df4d-4745-8f5b-4193e2efa8cd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:24.447956 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ab2bfdc4-df4d-4745-8f5b-4193e2efa8cd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:24.584290 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-8c3be55b-d803-4e8b-88f8-220a38ce5ac3 req-39e43a62-0354-4242-8ad4-5e5ba8b86fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb", "name": "network-vif-deleted", "tag": "ff25bf32-73a3-4dbc-8956-4b8f21c3165b"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:24.607804 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-8c3be55b-d803-4e8b-88f8-220a38ce5ac3 req-39e43a62-0354-4242-8ad4-5e5ba8b86fc5 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:24.608877 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-8c3be55b-d803-4e8b-88f8-220a38ce5ac3 req-39e43a62-0354-4242-8ad4-5e5ba8b86fc5 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:24.624859 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-8c3be55b-d803-4e8b-88f8-220a38ce5ac3 req-39e43a62-0354-4242-8ad4-5e5ba8b86fc5 service nova] Creating event network-vif-deleted:ff25bf32-73a3-4dbc-8956-4b8f21c3165b for instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb on hv-cinder-73306 Aug 01 07:43:24.641481 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-8c3be55b-d803-4e8b-88f8-220a38ce5ac3 req-39e43a62-0354-4242-8ad4-5e5ba8b86fc5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060089 Aug 01 07:43:24.643839 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 404/820] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:43:24.693478 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ab2bfdc4-df4d-4745-8f5b-4193e2efa8cd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:24.708727 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ab2bfdc4-df4d-4745-8f5b-4193e2efa8cd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:24.720283 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ab2bfdc4-df4d-4745-8f5b-4193e2efa8cd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:24.722789 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ab2bfdc4-df4d-4745-8f5b-4193e2efa8cd tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.292181 Aug 01 07:43:24.740293 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 417/821] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:24 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:25.236017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:25.236823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:25.245475 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:25.246011 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:25.246949 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:25.247452 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:25.279811 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:25.279811 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:25.280340 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lazy-loading 'fault' on Instance uuid b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:43:25.352140 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:25.363129 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c8b9d1b0-602d-43a8-9163-e75bce42417a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 200 len: 1230 microversion: 2.1 time: 0.131220 Aug 01 07:43:25.375496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 405/822] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:25 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 1230 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:25.745896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1b35f94e-03b4-4742-8a7c-1cf081f5e33a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:25.746548 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1b35f94e-03b4-4742-8a7c-1cf081f5e33a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:25.760502 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b35f94e-03b4-4742-8a7c-1cf081f5e33a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:25.761447 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b35f94e-03b4-4742-8a7c-1cf081f5e33a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:25.762851 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b35f94e-03b4-4742-8a7c-1cf081f5e33a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:25.763588 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1b35f94e-03b4-4742-8a7c-1cf081f5e33a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:26.220924 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1b35f94e-03b4-4742-8a7c-1cf081f5e33a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:26.231221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1b35f94e-03b4-4742-8a7c-1cf081f5e33a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:26.232615 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1b35f94e-03b4-4742-8a7c-1cf081f5e33a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:26.233490 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1b35f94e-03b4-4742-8a7c-1cf081f5e33a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1745 microversion: 2.20 time: 0.491504 Aug 01 07:43:26.234370 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 418/823] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:25 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1745 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:26.388583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7bc834be-40cc-4349-982b-3717d35c8e73 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:26.389204 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7bc834be-40cc-4349-982b-3717d35c8e73 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:26.397772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7bc834be-40cc-4349-982b-3717d35c8e73 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:26.398450 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7bc834be-40cc-4349-982b-3717d35c8e73 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:26.399287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7bc834be-40cc-4349-982b-3717d35c8e73 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:26.399736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7bc834be-40cc-4349-982b-3717d35c8e73 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:26.414583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-7bc834be-40cc-4349-982b-3717d35c8e73 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] HTTP exception thrown: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7bc834be-40cc-4349-982b-3717d35c8e73 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Request method failure captured: Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb HTTP/1.1 Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54M9aI3UB5p6FHeWVQuxgEmtCPY73hp3AUUoUvvcdPrKSzbuRzDMFDwB0iK3UlSca1Nhlp4-V5lWkZlvz0a0Lds2WOMm8d9BJbwLSnQAEIiYTqP1DWc2GOPzvQPYuaGwMs57fBwM0yuRyQi6t0IycnSqslUbEFuk6v_2AGHDJVfQXdE Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 810069989cfb42799139be8ec2423288 Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-TestVolumeBootPattern-745031385 Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:43:26.416807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/810069989cfb42799139be8ec2423288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/810069989cfb42799139be8ec2423288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/810069989cfb42799139be8ec2423288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_810069989cfb42799139be8ec2423288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-TestVolumeBootPattern-745031385 Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 810069989cfb42799139be8ec2423288 Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-TestVolumeBootPattern-745031385 Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-TestVolumeBootPattern-745031385-project Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 890be2e19b43473caa79b2dc889f8436 Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-TestVolumeBootPattern-745031385-project Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:43:26.418288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb'} Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:43:26.419120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:43:26.420501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:26.421711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7bc834be-40cc-4349-982b-3717d35c8e73 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Returning 404 to user: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:43:26.421711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7bc834be-40cc-4349-982b-3717d35c8e73 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 404 len: 111 microversion: 2.1 time: 0.033655 Aug 01 07:43:26.421711 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 406/824] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:26 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:43:26.534794 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-392869059", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1723413518", "security_groups": [{"name": "tempest-secgroup-smoke-1404206193"}], "block_device_mapping_v2": [{"uuid": "b6263c66-b6af-40bf-bf06-d273536592ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eaaa6e09-856c-4518-bc1e-d02d9efafed7"}]}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:26.669048 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.network.neutron [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] validate_networks() for [('eaaa6e09-856c-4518-bc1e-d02d9efafed7', None, None, None, None, None)] {{(pid=124279) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:43:27.075289 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Flavor limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:43:27.075828 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Image limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:43:27.076265 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Flavor pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:43:27.076674 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Image pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:43:27.077308 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:43:27.086780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:27.087271 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:27.088164 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:27.088691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:27.105989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Getting quotas for project 810069989cfb42799139be8ec2423288. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:43:27.110041 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Getting quotas for user 890be2e19b43473caa79b2dc889f8436 and project 810069989cfb42799139be8ec2423288. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:43:27.167865 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Going to run 1 instances... {{(pid=124279) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:43:27.169977 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6263c66-b6af-40bf-bf06-d273536592ff',volume_size=None,volume_type=None)] {{(pid=124279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:43:27.258568 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0fef9673-29be-4b44-8844-b8ec589aa010 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:27.259289 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0fef9673-29be-4b44-8844-b8ec589aa010 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:27.265357 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0fef9673-29be-4b44-8844-b8ec589aa010 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:27.265888 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0fef9673-29be-4b44-8844-b8ec589aa010 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:27.266920 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0fef9673-29be-4b44-8844-b8ec589aa010 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:27.267408 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0fef9673-29be-4b44-8844-b8ec589aa010 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:27.304475 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e0d05222-3147-4473-bc7d-3cad6bf08b29 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.773628 Aug 01 07:43:27.305713 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 419/825] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:43:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 07:43:27.321057 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-725b3945-6437-4f86-ad80-b01873f809d1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:27.321931 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-725b3945-6437-4f86-ad80-b01873f809d1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:27.383674 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-725b3945-6437-4f86-ad80-b01873f809d1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:27.392203 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-725b3945-6437-4f86-ad80-b01873f809d1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1094 microversion: 2.1 time: 0.079749 Aug 01 07:43:27.393099 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 420/826] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:27 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:27.446867 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0fef9673-29be-4b44-8844-b8ec589aa010 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:27.458958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0fef9673-29be-4b44-8844-b8ec589aa010 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:27.464313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0fef9673-29be-4b44-8844-b8ec589aa010 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:27.466063 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0fef9673-29be-4b44-8844-b8ec589aa010 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1745 microversion: 2.20 time: 0.212118 Aug 01 07:43:27.471123 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 407/827] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:27 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1745 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:27.889379 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-737c7562-8dd4-4a97-a99a-40b180552423 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] Action: 'create', calling method: .version_select at 0x7fd0188de700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2012544133", "metadata": {"Type": "work"}}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:28.204799 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-737c7562-8dd4-4a97-a99a-40b180552423 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.457592 Aug 01 07:43:28.205413 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 421/828] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Aug 1 07:43:27 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 459 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 07:43:28.218377 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0ce64036-b7e0-499f-b2ba-35bab48cd172 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] Calling method '.version_select at 0x7fd0189641f0>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:28.271607 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0ce64036-b7e0-499f-b2ba-35bab48cd172 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b" status: 200 len: 353 microversion: 2.1 time: 0.056945 Aug 01 07:43:28.272174 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 408/829] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:43:28 2022] GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:28.415027 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b7eef2a5-ee84-4d9f-8b6e-e9938cceb757 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:28.415946 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b7eef2a5-ee84-4d9f-8b6e-e9938cceb757 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:28.422639 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b7eef2a5-ee84-4d9f-8b6e-e9938cceb757 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:28.423348 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b7eef2a5-ee84-4d9f-8b6e-e9938cceb757 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:28.424126 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b7eef2a5-ee84-4d9f-8b6e-e9938cceb757 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:28.424569 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b7eef2a5-ee84-4d9f-8b6e-e9938cceb757 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:28.493308 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-727c5f7c-2323-418f-b7a1-aafe6e2b4b77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:28.496252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-727c5f7c-2323-418f-b7a1-aafe6e2b4b77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:28.506421 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-727c5f7c-2323-418f-b7a1-aafe6e2b4b77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:28.507878 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-727c5f7c-2323-418f-b7a1-aafe6e2b4b77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:28.509753 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-727c5f7c-2323-418f-b7a1-aafe6e2b4b77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:28.510301 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-727c5f7c-2323-418f-b7a1-aafe6e2b4b77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:28.531631 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b7eef2a5-ee84-4d9f-8b6e-e9938cceb757 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:28.541209 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b7eef2a5-ee84-4d9f-8b6e-e9938cceb757 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1200 microversion: 2.1 time: 0.131696 Aug 01 07:43:28.542092 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 422/830] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:28 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1200 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:28.783116 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-727c5f7c-2323-418f-b7a1-aafe6e2b4b77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:28.792118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-727c5f7c-2323-418f-b7a1-aafe6e2b4b77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:28.794224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-727c5f7c-2323-418f-b7a1-aafe6e2b4b77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:28.795449 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-727c5f7c-2323-418f-b7a1-aafe6e2b4b77 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1740 microversion: 2.20 time: 0.308662 Aug 01 07:43:28.796014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 409/831] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:28 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:29.286008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-08d57543-50cc-4cdf-a0be-11830b016c06 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] Calling method '.version_select at 0x7fd01875c820>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:29.393288 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-08d57543-50cc-4cdf-a0be-11830b016c06 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b" status: 200 len: 354 microversion: 2.1 time: 0.111723 Aug 01 07:43:29.394863 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 423/832] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:43:29 2022] GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:29.408702 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1e099a4b-4590-457d-9b02-624928526797 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] Calling method '.version_select at 0x7fd018964a60>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:29.494241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1e099a4b-4590-457d-9b02-624928526797 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b" status: 200 len: 354 microversion: 2.1 time: 0.089569 Aug 01 07:43:29.503220 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 410/833] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:43:29 2022] GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:29.515380 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8f9315f0-a3fd-404f-a311-ef3522529555 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] Calling method '.version_select at 0x7fd0189bb8b0>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:29.564203 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7226a175-9d16-4078-9878-13ee93467850 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:29.564740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7226a175-9d16-4078-9878-13ee93467850 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:29.577583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7226a175-9d16-4078-9878-13ee93467850 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:29.583366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7226a175-9d16-4078-9878-13ee93467850 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:29.584557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7226a175-9d16-4078-9878-13ee93467850 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:29.585006 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7226a175-9d16-4078-9878-13ee93467850 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:29.666602 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8f9315f0-a3fd-404f-a311-ef3522529555 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b" status: 202 len: 0 microversion: 2.1 time: 0.155578 Aug 01 07:43:29.667813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 424/834] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 1 07:43:29 2022] DELETE /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:43:29.676530 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c5268e64-f699-4a87-bc26-89af93563756 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] Calling method '.version_select at 0x7fd018975940>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:29.799736 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c5268e64-f699-4a87-bc26-89af93563756 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b" status: 200 len: 353 microversion: 2.1 time: 0.127742 Aug 01 07:43:29.802528 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 425/835] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:43:29 2022] GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:29.919180 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-f2f704e0-8e06-47db-8bd2-c78131955dc2 req-c2ecbd66-e55e-4fa4-a708-f88850656dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f30f324-1dcf-44b9-b81d-ef96811b0a87", "name": "network-vif-plugged", "status": "completed", "tag": "23ceaa56-07cb-42cc-83de-2bfdae7aac98"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:29.939045 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-f2f704e0-8e06-47db-8bd2-c78131955dc2 req-c2ecbd66-e55e-4fa4-a708-f88850656dd3 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:29.939930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-f2f704e0-8e06-47db-8bd2-c78131955dc2 req-c2ecbd66-e55e-4fa4-a708-f88850656dd3 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:29.969128 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-f2f704e0-8e06-47db-8bd2-c78131955dc2 req-c2ecbd66-e55e-4fa4-a708-f88850656dd3 service nova] Creating event network-vif-plugged:23ceaa56-07cb-42cc-83de-2bfdae7aac98 for instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 on hv-cinder-73306 Aug 01 07:43:29.980841 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-f2f704e0-8e06-47db-8bd2-c78131955dc2 req-c2ecbd66-e55e-4fa4-a708-f88850656dd3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176395 Aug 01 07:43:29.982501 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 426/836] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:29.990391 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-62ee933b-d07e-48ab-8d0a-5472901ae3b0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:29.991475 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-62ee933b-d07e-48ab-8d0a-5472901ae3b0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:29.999683 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-62ee933b-d07e-48ab-8d0a-5472901ae3b0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:30.001097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-62ee933b-d07e-48ab-8d0a-5472901ae3b0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:30.004283 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-62ee933b-d07e-48ab-8d0a-5472901ae3b0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:30.005036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-62ee933b-d07e-48ab-8d0a-5472901ae3b0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:30.053670 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7226a175-9d16-4078-9878-13ee93467850 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:30.079371 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7226a175-9d16-4078-9878-13ee93467850 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.505036 Aug 01 07:43:30.080809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 411/837] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:29 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:30.210449 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-62ee933b-d07e-48ab-8d0a-5472901ae3b0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:30.220507 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-62ee933b-d07e-48ab-8d0a-5472901ae3b0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:30.223351 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-62ee933b-d07e-48ab-8d0a-5472901ae3b0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:30.225288 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-62ee933b-d07e-48ab-8d0a-5472901ae3b0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1740 microversion: 2.20 time: 0.239712 Aug 01 07:43:30.227455 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 427/838] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:29 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:30.439173 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-a581c4a9-b504-4aef-8f2b-41970db068bb req-e910abce-8fd7-483d-92d0-3d6b9c13ca39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ea6b56-5481-4605-b6df-ad8b3d7a1eb2", "tag": "f430032e-c17e-4c53-8b5f-6ac11189c17a"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:30.480430 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-a581c4a9-b504-4aef-8f2b-41970db068bb req-e910abce-8fd7-483d-92d0-3d6b9c13ca39 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:30.481014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-a581c4a9-b504-4aef-8f2b-41970db068bb req-e910abce-8fd7-483d-92d0-3d6b9c13ca39 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:30.495366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:30.498189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-a581c4a9-b504-4aef-8f2b-41970db068bb req-e910abce-8fd7-483d-92d0-3d6b9c13ca39 service nova] Creating event network-changed:f430032e-c17e-4c53-8b5f-6ac11189c17a for instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 on hv-cinder-73306 Aug 01 07:43:30.506946 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-a581c4a9-b504-4aef-8f2b-41970db068bb req-e910abce-8fd7-483d-92d0-3d6b9c13ca39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071722 Aug 01 07:43:30.507884 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 412/839] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:30.817093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-87e9375b-a76a-489b-8396-92ec79053021 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] Calling method '.version_select at 0x7fd0189db940>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:30.860412 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-87e9375b-a76a-489b-8396-92ec79053021 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] HTTP exception thrown: Volume c70d7c5a-49fc-49c6-a49e-554d8af6376b could not be found. Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-87e9375b-a76a-489b-8396-92ec79053021 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] Request method failure captured: Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b HTTP/1.1 Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54Qfon7L7lQxUFSP4KX2zuLoJpD-9qGhrCv4hE0gJcmLoLdTQcQXROAvkOZtLhTqBRJPG0D024iSRoPDl9F97oG45r2wJqK3a_vHbdD7d2vS6_W8vgmv0oxAaqBWi-TZYf8LTX6tL1GM2XIuf7RX6Jd1mmoXN3syLN0g1kxRmdEwpfg Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 698542bb944943809d891c35e7e5327a Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-VolumesGetTestJSON-898358035 Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:43:30.862523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/698542bb944943809d891c35e7e5327a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/698542bb944943809d891c35e7e5327a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/698542bb944943809d891c35e7e5327a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_698542bb944943809d891c35e7e5327a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-VolumesGetTestJSON-898358035 Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 698542bb944943809d891c35e7e5327a Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-VolumesGetTestJSON-898358035 Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-VolumesGetTestJSON-898358035-project Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: a34b98469a3244f287772ef8c50fb8e8 Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-VolumesGetTestJSON-898358035-project Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Volume c70d7c5a-49fc-49c6-a49e-554d8af6376b could not be found. Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': 'c70d7c5a-49fc-49c6-a49e-554d8af6376b'} Aug 01 07:43:30.864877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c70d7c5a-49fc-49c6-a49e-554d8af6376b could not be found. (HTTP 404) (Request-ID: req-2a82852c-140d-468a-96d1-f83d546a8a79) Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:30.865778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 07:43:30.868750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c70d7c5a-49fc-49c6-a49e-554d8af6376b could not be found. Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 07:43:30.871316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c70d7c5a-49fc-49c6-a49e-554d8af6376b could not be found. Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c70d7c5a-49fc-49c6-a49e-554d8af6376b could not be found. Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-87e9375b-a76a-489b-8396-92ec79053021 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] Returning 404 to user: Volume c70d7c5a-49fc-49c6-a49e-554d8af6376b could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:43:30.874521 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-87e9375b-a76a-489b-8396-92ec79053021 tempest-VolumesGetTestJSON-898358035 tempest-VolumesGetTestJSON-898358035-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b" status: 404 len: 109 microversion: 2.1 time: 0.054318 Aug 01 07:43:30.877826 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 428/840] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:43:30 2022] GET /compute/v2.1/os-volumes/c70d7c5a-49fc-49c6-a49e-554d8af6376b => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:43:31.104267 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-388000b5-6ff6-4a72-9ba0-76cbc13d9e39 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:31.105271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-388000b5-6ff6-4a72-9ba0-76cbc13d9e39 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:31.112436 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-388000b5-6ff6-4a72-9ba0-76cbc13d9e39 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:31.113005 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-388000b5-6ff6-4a72-9ba0-76cbc13d9e39 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:31.114508 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-388000b5-6ff6-4a72-9ba0-76cbc13d9e39 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:31.114943 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-388000b5-6ff6-4a72-9ba0-76cbc13d9e39 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:31.256620 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2be3af16-ea76-465b-812b-cb7b68ce0a5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:31.257236 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2be3af16-ea76-465b-812b-cb7b68ce0a5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:31.274881 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2be3af16-ea76-465b-812b-cb7b68ce0a5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:31.276861 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2be3af16-ea76-465b-812b-cb7b68ce0a5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:31.277877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2be3af16-ea76-465b-812b-cb7b68ce0a5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:31.279362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2be3af16-ea76-465b-812b-cb7b68ce0a5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:31.372082 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-388000b5-6ff6-4a72-9ba0-76cbc13d9e39 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:31.380234 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-388000b5-6ff6-4a72-9ba0-76cbc13d9e39 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.281487 Aug 01 07:43:31.383760 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 413/841] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:31 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:31.467575 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2be3af16-ea76-465b-812b-cb7b68ce0a5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:31.477225 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2be3af16-ea76-465b-812b-cb7b68ce0a5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:31.485049 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2be3af16-ea76-465b-812b-cb7b68ce0a5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:31.486516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2be3af16-ea76-465b-812b-cb7b68ce0a5f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1740 microversion: 2.20 time: 0.236837 Aug 01 07:43:31.489980 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 429/842] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:31 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:32.412344 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7e04e06e-fa70-469b-990b-093fa88a183c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:32.412999 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7e04e06e-fa70-469b-990b-093fa88a183c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:32.419855 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e04e06e-fa70-469b-990b-093fa88a183c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:32.431729 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e04e06e-fa70-469b-990b-093fa88a183c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:32.431729 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e04e06e-fa70-469b-990b-093fa88a183c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:32.431729 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7e04e06e-fa70-469b-990b-093fa88a183c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:32.517806 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5bf7d5ed-685b-4687-869e-2ed604882470 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:32.519105 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5bf7d5ed-685b-4687-869e-2ed604882470 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:32.530350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf7d5ed-685b-4687-869e-2ed604882470 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:32.537188 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf7d5ed-685b-4687-869e-2ed604882470 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:32.548173 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf7d5ed-685b-4687-869e-2ed604882470 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:32.548988 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf7d5ed-685b-4687-869e-2ed604882470 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:32.615753 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7e04e06e-fa70-469b-990b-093fa88a183c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:32.628275 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7e04e06e-fa70-469b-990b-093fa88a183c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.220481 Aug 01 07:43:32.635216 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 414/843] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:32 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:32.740015 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5bf7d5ed-685b-4687-869e-2ed604882470 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:32.752345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5bf7d5ed-685b-4687-869e-2ed604882470 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:32.754438 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5bf7d5ed-685b-4687-869e-2ed604882470 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:32.756090 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5bf7d5ed-685b-4687-869e-2ed604882470 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1740 microversion: 2.20 time: 0.246046 Aug 01 07:43:32.757054 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 430/844] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:32 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:33.649166 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-20457699-a4ae-41d1-a88e-59f898d28a81 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:33.650100 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-20457699-a4ae-41d1-a88e-59f898d28a81 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:33.668569 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-20457699-a4ae-41d1-a88e-59f898d28a81 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:33.670240 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-20457699-a4ae-41d1-a88e-59f898d28a81 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:33.671035 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-20457699-a4ae-41d1-a88e-59f898d28a81 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:33.671498 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-20457699-a4ae-41d1-a88e-59f898d28a81 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:33.754853 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-515159e5-7f20-4f2b-adfd-3e54bb2b475b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1502450041"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:33.755428 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-515159e5-7f20-4f2b-adfd-3e54bb2b475b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:33.771497 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-515159e5-7f20-4f2b-adfd-3e54bb2b475b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:33.772263 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-515159e5-7f20-4f2b-adfd-3e54bb2b475b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:33.773244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-515159e5-7f20-4f2b-adfd-3e54bb2b475b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:33.773830 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-515159e5-7f20-4f2b-adfd-3e54bb2b475b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:33.934639 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-20457699-a4ae-41d1-a88e-59f898d28a81 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:33.937488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.network.security_group_api [None req-515159e5-7f20-4f2b-adfd-3e54bb2b475b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Removing security group 658ab7c7-37de-4fe8-a7d6-e7a76339cfe0 from port 2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f Aug 01 07:43:33.943879 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-20457699-a4ae-41d1-a88e-59f898d28a81 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.298713 Aug 01 07:43:33.944669 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 415/845] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:33 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:33.964999 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-570a6a3d-036e-447c-93bb-473e89fe215d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:33.966622 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-570a6a3d-036e-447c-93bb-473e89fe215d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:33.973487 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-570a6a3d-036e-447c-93bb-473e89fe215d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:33.974207 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-570a6a3d-036e-447c-93bb-473e89fe215d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:33.975256 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-570a6a3d-036e-447c-93bb-473e89fe215d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:33.975864 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-570a6a3d-036e-447c-93bb-473e89fe215d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:34.214407 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-570a6a3d-036e-447c-93bb-473e89fe215d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:34.224301 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-570a6a3d-036e-447c-93bb-473e89fe215d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:34.225818 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-570a6a3d-036e-447c-93bb-473e89fe215d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:34.226974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-570a6a3d-036e-447c-93bb-473e89fe215d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1740 microversion: 2.20 time: 0.266069 Aug 01 07:43:34.227563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 416/846] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:33 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:34.400144 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-515159e5-7f20-4f2b-adfd-3e54bb2b475b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "POST /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/action" status: 202 len: 0 microversion: 2.1 time: 0.652741 Aug 01 07:43:34.401198 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 431/847] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 1 07:43:33 2022] POST /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:43:34.656492 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-98e44690-3b46-47ba-9c49-e24ccc090b89 req-864fb993-94f0-41ec-a6ce-d6f20643b67b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587f64fe-aa07-43ef-942a-883dfa6b585c", "tag": "2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:34.673710 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-98e44690-3b46-47ba-9c49-e24ccc090b89 req-864fb993-94f0-41ec-a6ce-d6f20643b67b service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:34.674581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-98e44690-3b46-47ba-9c49-e24ccc090b89 req-864fb993-94f0-41ec-a6ce-d6f20643b67b service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:34.688250 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-98e44690-3b46-47ba-9c49-e24ccc090b89 req-864fb993-94f0-41ec-a6ce-d6f20643b67b service nova] Creating event network-changed:2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f for instance 587f64fe-aa07-43ef-942a-883dfa6b585c on hv-cinder-73306 Aug 01 07:43:34.695486 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-98e44690-3b46-47ba-9c49-e24ccc090b89 req-864fb993-94f0-41ec-a6ce-d6f20643b67b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275998 Aug 01 07:43:34.696808 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 417/848] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:34.967689 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9e658837-02ca-4fa4-aeb5-bc6db9d2d19e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:34.969423 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9e658837-02ca-4fa4-aeb5-bc6db9d2d19e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:34.978440 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9e658837-02ca-4fa4-aeb5-bc6db9d2d19e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:34.984553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9e658837-02ca-4fa4-aeb5-bc6db9d2d19e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:34.985725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9e658837-02ca-4fa4-aeb5-bc6db9d2d19e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:34.987451 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9e658837-02ca-4fa4-aeb5-bc6db9d2d19e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:35.192214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9e658837-02ca-4fa4-aeb5-bc6db9d2d19e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:35.201870 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9e658837-02ca-4fa4-aeb5-bc6db9d2d19e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.237936 Aug 01 07:43:35.215428 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 432/849] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:34 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:35.253663 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9aa6b945-7f6a-4ceb-9370-58001bdf5c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:35.254459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9aa6b945-7f6a-4ceb-9370-58001bdf5c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:35.265546 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9aa6b945-7f6a-4ceb-9370-58001bdf5c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:35.266062 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9aa6b945-7f6a-4ceb-9370-58001bdf5c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:35.266807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9aa6b945-7f6a-4ceb-9370-58001bdf5c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:35.271113 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9aa6b945-7f6a-4ceb-9370-58001bdf5c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:35.970005 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9aa6b945-7f6a-4ceb-9370-58001bdf5c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:35.979138 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9aa6b945-7f6a-4ceb-9370-58001bdf5c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:35.980983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9aa6b945-7f6a-4ceb-9370-58001bdf5c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:35.982357 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9aa6b945-7f6a-4ceb-9370-58001bdf5c92 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1740 microversion: 2.20 time: 0.733275 Aug 01 07:43:35.983431 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 418/850] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:35 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1740 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:36.239616 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-061ff982-bffe-4771-a97f-ab1bc6b0cfc6 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:36.241464 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-061ff982-bffe-4771-a97f-ab1bc6b0cfc6 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:36.257443 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-061ff982-bffe-4771-a97f-ab1bc6b0cfc6 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:36.258367 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-061ff982-bffe-4771-a97f-ab1bc6b0cfc6 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:36.260944 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-061ff982-bffe-4771-a97f-ab1bc6b0cfc6 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:36.262430 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-061ff982-bffe-4771-a97f-ab1bc6b0cfc6 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:36.443488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-061ff982-bffe-4771-a97f-ab1bc6b0cfc6 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:36.451557 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-061ff982-bffe-4771-a97f-ab1bc6b0cfc6 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.229761 Aug 01 07:43:36.453032 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 433/851] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:36 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:36.648751 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-277e3e38-752c-4327-83c5-3cf1a34fa4bd req-f0da3b20-aa24-4184-b92a-52ef9488e208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587f64fe-aa07-43ef-942a-883dfa6b585c", "tag": "2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:36.651091 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fd838400-e0c0-45ef-82ca-6ce3f948c3ea tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:36.654258 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fd838400-e0c0-45ef-82ca-6ce3f948c3ea tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:36.668728 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-277e3e38-752c-4327-83c5-3cf1a34fa4bd req-f0da3b20-aa24-4184-b92a-52ef9488e208 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:36.670633 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fd838400-e0c0-45ef-82ca-6ce3f948c3ea tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:36.671426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fd838400-e0c0-45ef-82ca-6ce3f948c3ea tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:36.672402 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fd838400-e0c0-45ef-82ca-6ce3f948c3ea tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:36.672842 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fd838400-e0c0-45ef-82ca-6ce3f948c3ea tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:36.677944 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-277e3e38-752c-4327-83c5-3cf1a34fa4bd req-f0da3b20-aa24-4184-b92a-52ef9488e208 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:36.698492 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-277e3e38-752c-4327-83c5-3cf1a34fa4bd req-f0da3b20-aa24-4184-b92a-52ef9488e208 service nova] Creating event network-changed:2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f for instance 587f64fe-aa07-43ef-942a-883dfa6b585c on hv-cinder-73306 Aug 01 07:43:36.705276 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-277e3e38-752c-4327-83c5-3cf1a34fa4bd req-f0da3b20-aa24-4184-b92a-52ef9488e208 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060162 Aug 01 07:43:36.709910 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 434/852] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:36.808770 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-fd838400-e0c0-45ef-82ca-6ce3f948c3ea tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lazy-loading 'services' on Instance uuid 587f64fe-aa07-43ef-942a-883dfa6b585c {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:43:36.907611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fd838400-e0c0-45ef-82ca-6ce3f948c3ea tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "DELETE /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments/6c24aee5-9625-4455-8f4e-5d92bd582a2e" status: 202 len: 0 microversion: 2.1 time: 0.266149 Aug 01 07:43:36.919522 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6f85a9e4-84eb-4aa1-97b0-b245b774b12b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:36.926253 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6f85a9e4-84eb-4aa1-97b0-b245b774b12b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:36.929421 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 419/853] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:43:36 2022] DELETE /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments/6c24aee5-9625-4455-8f4e-5d92bd582a2e => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:43:36.937035 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6f85a9e4-84eb-4aa1-97b0-b245b774b12b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:36.938184 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6f85a9e4-84eb-4aa1-97b0-b245b774b12b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:36.939460 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6f85a9e4-84eb-4aa1-97b0-b245b774b12b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:36.940123 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6f85a9e4-84eb-4aa1-97b0-b245b774b12b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:37.009012 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5458822e-4210-4085-a044-a49e57afc532 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:37.009719 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6f85a9e4-84eb-4aa1-97b0-b245b774b12b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095489 Aug 01 07:43:37.010024 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5458822e-4210-4085-a044-a49e57afc532 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:37.015336 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 435/854] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:43:36 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:37.029394 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5458822e-4210-4085-a044-a49e57afc532 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:37.030204 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5458822e-4210-4085-a044-a49e57afc532 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:37.031680 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5458822e-4210-4085-a044-a49e57afc532 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:37.032341 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5458822e-4210-4085-a044-a49e57afc532 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:37.336296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5458822e-4210-4085-a044-a49e57afc532 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:37.353362 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5458822e-4210-4085-a044-a49e57afc532 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:37.361185 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5458822e-4210-4085-a044-a49e57afc532 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:37.363652 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5458822e-4210-4085-a044-a49e57afc532 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1740 microversion: 2.20 time: 0.361196 Aug 01 07:43:37.367876 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 420/855] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:37 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1740 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:43:37.473121 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-19d2ff43-2b8a-4b8c-ac15-6d8bddae7451 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:37.474344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-19d2ff43-2b8a-4b8c-ac15-6d8bddae7451 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:37.476558 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:37.477782 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=8 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:37.483906 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-19d2ff43-2b8a-4b8c-ac15-6d8bddae7451 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:37.484684 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-19d2ff43-2b8a-4b8c-ac15-6d8bddae7451 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:37.485686 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-19d2ff43-2b8a-4b8c-ac15-6d8bddae7451 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:37.486345 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-19d2ff43-2b8a-4b8c-ac15-6d8bddae7451 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:37.679928 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-19d2ff43-2b8a-4b8c-ac15-6d8bddae7451 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:37.689529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-19d2ff43-2b8a-4b8c-ac15-6d8bddae7451 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.220038 Aug 01 07:43:37.703107 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 436/856] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:37 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:38.021806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-817bc081-30ee-47fe-9017-4fe29035703b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:38.024189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-817bc081-30ee-47fe-9017-4fe29035703b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:38.032526 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-817bc081-30ee-47fe-9017-4fe29035703b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:38.033374 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-817bc081-30ee-47fe-9017-4fe29035703b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:38.034992 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-817bc081-30ee-47fe-9017-4fe29035703b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:38.035675 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-817bc081-30ee-47fe-9017-4fe29035703b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:38.078589 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-817bc081-30ee-47fe-9017-4fe29035703b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060167 Aug 01 07:43:38.079530 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 421/857] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:43:38 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:38.390596 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-df44fc40-e91e-4f6f-9222-7b8a04e5c0af tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:38.391594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-df44fc40-e91e-4f6f-9222-7b8a04e5c0af tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:38.398983 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-df44fc40-e91e-4f6f-9222-7b8a04e5c0af tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:38.399783 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-df44fc40-e91e-4f6f-9222-7b8a04e5c0af tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:38.400792 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-df44fc40-e91e-4f6f-9222-7b8a04e5c0af tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:38.401553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-df44fc40-e91e-4f6f-9222-7b8a04e5c0af tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:38.559507 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-df44fc40-e91e-4f6f-9222-7b8a04e5c0af tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:38.569762 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-df44fc40-e91e-4f6f-9222-7b8a04e5c0af tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:38.571923 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-df44fc40-e91e-4f6f-9222-7b8a04e5c0af tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:38.573156 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-df44fc40-e91e-4f6f-9222-7b8a04e5c0af tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1740 microversion: 2.20 time: 0.186508 Aug 01 07:43:38.573917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 437/858] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:38 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:38.711848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3762d076-8244-4216-b832-5e4087154404 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:38.712579 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3762d076-8244-4216-b832-5e4087154404 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:38.719326 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3762d076-8244-4216-b832-5e4087154404 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:38.719880 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3762d076-8244-4216-b832-5e4087154404 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:38.720746 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3762d076-8244-4216-b832-5e4087154404 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:38.721268 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3762d076-8244-4216-b832-5e4087154404 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:38.868620 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3762d076-8244-4216-b832-5e4087154404 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:38.879432 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3762d076-8244-4216-b832-5e4087154404 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.170291 Aug 01 07:43:38.879432 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 422/859] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:38 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:39.092396 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8763d75b-4c37-4876-a4ba-4fd74da4dc79 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:39.095783 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8763d75b-4c37-4876-a4ba-4fd74da4dc79 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:39.102925 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8763d75b-4c37-4876-a4ba-4fd74da4dc79 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:39.103738 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8763d75b-4c37-4876-a4ba-4fd74da4dc79 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:39.104758 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8763d75b-4c37-4876-a4ba-4fd74da4dc79 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:39.105305 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8763d75b-4c37-4876-a4ba-4fd74da4dc79 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:39.141097 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8763d75b-4c37-4876-a4ba-4fd74da4dc79 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053184 Aug 01 07:43:39.141962 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 438/860] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:43:39 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:39.597568 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6612cd9d-2abf-421c-921b-45145817e6a9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:39.598145 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6612cd9d-2abf-421c-921b-45145817e6a9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:39.600971 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:39.606587 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6612cd9d-2abf-421c-921b-45145817e6a9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:39.607051 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6612cd9d-2abf-421c-921b-45145817e6a9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:39.607886 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6612cd9d-2abf-421c-921b-45145817e6a9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:39.608492 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6612cd9d-2abf-421c-921b-45145817e6a9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:39.633234 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c534179a-82b7-4da2-9091-db7578fdd82a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:39.634016 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c534179a-82b7-4da2-9091-db7578fdd82a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:39.645465 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c534179a-82b7-4da2-9091-db7578fdd82a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:39.646056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c534179a-82b7-4da2-9091-db7578fdd82a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:39.647606 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c534179a-82b7-4da2-9091-db7578fdd82a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:39.648235 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c534179a-82b7-4da2-9091-db7578fdd82a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:39.681193 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c534179a-82b7-4da2-9091-db7578fdd82a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/ips" status: 200 len: 146 microversion: 2.1 time: 0.051829 Aug 01 07:43:39.681779 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 439/861] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 1 07:43:39 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:39.786870 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6612cd9d-2abf-421c-921b-45145817e6a9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:39.795320 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6612cd9d-2abf-421c-921b-45145817e6a9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:39.796886 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6612cd9d-2abf-421c-921b-45145817e6a9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:39.798068 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6612cd9d-2abf-421c-921b-45145817e6a9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1740 microversion: 2.20 time: 0.205230 Aug 01 07:43:39.798631 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 423/862] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:39 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:39.899038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f75c8ec3-a6b5-4074-b097-5861563ec7f9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:39.899683 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f75c8ec3-a6b5-4074-b097-5861563ec7f9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:39.906077 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f75c8ec3-a6b5-4074-b097-5861563ec7f9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:39.906535 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f75c8ec3-a6b5-4074-b097-5861563ec7f9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:39.907346 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f75c8ec3-a6b5-4074-b097-5861563ec7f9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:39.907792 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f75c8ec3-a6b5-4074-b097-5861563ec7f9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:40.061022 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f75c8ec3-a6b5-4074-b097-5861563ec7f9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:40.069194 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f75c8ec3-a6b5-4074-b097-5861563ec7f9 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.174016 Aug 01 07:43:40.069756 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 440/863] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:39 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:40.154702 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-75649825-b486-456a-b3ff-1cfd2861e834 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:40.156869 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-75649825-b486-456a-b3ff-1cfd2861e834 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:40.163579 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-75649825-b486-456a-b3ff-1cfd2861e834 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:40.164030 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-75649825-b486-456a-b3ff-1cfd2861e834 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:40.164791 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-75649825-b486-456a-b3ff-1cfd2861e834 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:40.165223 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-75649825-b486-456a-b3ff-1cfd2861e834 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:40.193418 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-75649825-b486-456a-b3ff-1cfd2861e834 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042851 Aug 01 07:43:40.193961 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 424/864] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:43:40 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:40.822373 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-fd778217-1ec5-42b9-8464-8c6944d7708f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:40.823149 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-fd778217-1ec5-42b9-8464-8c6944d7708f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:40.829883 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fd778217-1ec5-42b9-8464-8c6944d7708f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:40.830448 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fd778217-1ec5-42b9-8464-8c6944d7708f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:40.831386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fd778217-1ec5-42b9-8464-8c6944d7708f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:40.831977 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fd778217-1ec5-42b9-8464-8c6944d7708f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:40.975916 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fd778217-1ec5-42b9-8464-8c6944d7708f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:40.980373 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=100 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:40.991819 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fd778217-1ec5-42b9-8464-8c6944d7708f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:40.997292 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fd778217-1ec5-42b9-8464-8c6944d7708f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:40.999791 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-fd778217-1ec5-42b9-8464-8c6944d7708f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1740 microversion: 2.20 time: 0.181198 Aug 01 07:43:41.001670 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 441/865] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:40 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:41.051205 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6883520f-48bf-48a9-883b-b780f9ded28f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a2a12bd-e86e-4b20-b285-71a326d876dd"}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:41.054883 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6883520f-48bf-48a9-883b-b780f9ded28f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:41.061414 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6883520f-48bf-48a9-883b-b780f9ded28f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:41.062118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6883520f-48bf-48a9-883b-b780f9ded28f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:41.062921 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6883520f-48bf-48a9-883b-b780f9ded28f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:41.063388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6883520f-48bf-48a9-883b-b780f9ded28f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:41.089969 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a721fd62-193c-49ef-b6bb-da2633bb598b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:41.090487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a721fd62-193c-49ef-b6bb-da2633bb598b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:41.108502 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a721fd62-193c-49ef-b6bb-da2633bb598b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:41.108962 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a721fd62-193c-49ef-b6bb-da2633bb598b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:41.110062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a721fd62-193c-49ef-b6bb-da2633bb598b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:41.110495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a721fd62-193c-49ef-b6bb-da2633bb598b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:41.281271 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a721fd62-193c-49ef-b6bb-da2633bb598b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:41.296695 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a721fd62-193c-49ef-b6bb-da2633bb598b tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.210397 Aug 01 07:43:41.297751 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 442/866] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:41 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:41.318994 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-828b7168-fafe-4ff8-af8a-5de7dee9743a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:41.322873 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-828b7168-fafe-4ff8-af8a-5de7dee9743a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:41.334162 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-828b7168-fafe-4ff8-af8a-5de7dee9743a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:41.334957 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-828b7168-fafe-4ff8-af8a-5de7dee9743a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:41.336353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-828b7168-fafe-4ff8-af8a-5de7dee9743a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:41.337143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-828b7168-fafe-4ff8-af8a-5de7dee9743a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:41.355762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6883520f-48bf-48a9-883b-b780f9ded28f tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309816 Aug 01 07:43:41.356450 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 425/867] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:43:41 2022] POST /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:41.396805 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-828b7168-fafe-4ff8-af8a-5de7dee9743a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097342 Aug 01 07:43:41.398266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 443/868] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:43:41 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 07:43:41.412452 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3cb92ce8-9b0c-4d9b-a7d1-0a74b8c7c90c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:41.413351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3cb92ce8-9b0c-4d9b-a7d1-0a74b8c7c90c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:41.422457 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3cb92ce8-9b0c-4d9b-a7d1-0a74b8c7c90c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:41.423145 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3cb92ce8-9b0c-4d9b-a7d1-0a74b8c7c90c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:41.424095 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3cb92ce8-9b0c-4d9b-a7d1-0a74b8c7c90c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:41.424947 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3cb92ce8-9b0c-4d9b-a7d1-0a74b8c7c90c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:41.525426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-3cb92ce8-9b0c-4d9b-a7d1-0a74b8c7c90c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] HTTP exception thrown: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c is not attached to volume 6c24aee5-9625-4455-8f4e-5d92bd582a2e Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3cb92ce8-9b0c-4d9b-a7d1-0a74b8c7c90c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Request method failure captured: Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments/6c24aee5-9625-4455-8f4e-5d92bd582a2e HTTP/1.1 Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54OHmxFcP1JGpeXxgfC24C0JMOfprswQ4yLa7cGf6uh-tp_AG4QjW6b7o-j5j9aFH0J7giFrqxhJJRq04hJ5SjyVhJT2ib35I5fZy4cTo39X8c5AwV6x9MWuy8XWq4TAwtSJPN6uwLpYfYVibW4cvSNwrZgY3wXsOJMv7HshCdbThHE Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: a27abd6ed13c4174a4c14226fb48e146 Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-TestMinimumBasicScenario-215761294 Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:43:41.532790 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a27abd6ed13c4174a4c14226fb48e146"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a27abd6ed13c4174a4c14226fb48e146"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a27abd6ed13c4174a4c14226fb48e146"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a27abd6ed13c4174a4c14226fb48e146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-TestMinimumBasicScenario-215761294 Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: a27abd6ed13c4174a4c14226fb48e146 Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-TestMinimumBasicScenario-215761294 Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-TestMinimumBasicScenario-215761294-project Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 6e461e65817648b0a878d8280c84dc6e Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-TestMinimumBasicScenario-215761294-project Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:43:41.535809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c is not attached to volume 6c24aee5-9625-4455-8f4e-5d92bd582a2e Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'server_id': '587f64fe-aa07-43ef-942a-883dfa6b585c', 'id': '6c24aee5-9625-4455-8f4e-5d92bd582a2e'} Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6c24aee5-9625-4455-8f4e-5d92bd582a2e. Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:43:41.536988 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c is not attached to volume 6c24aee5-9625-4455-8f4e-5d92bd582a2e Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c is not attached to volume 6c24aee5-9625-4455-8f4e-5d92bd582a2e Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:43:41.538551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3cb92ce8-9b0c-4d9b-a7d1-0a74b8c7c90c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Returning 404 to user: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c is not attached to volume 6c24aee5-9625-4455-8f4e-5d92bd582a2e {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:43:41.540056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3cb92ce8-9b0c-4d9b-a7d1-0a74b8c7c90c tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "DELETE /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments/6c24aee5-9625-4455-8f4e-5d92bd582a2e" status: 404 len: 154 microversion: 2.1 time: 0.127518 Aug 01 07:43:41.540056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 426/869] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:43:41 2022] DELETE /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c/os-volume_attachments/6c24aee5-9625-4455-8f4e-5d92bd582a2e => generated 154 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 07:43:41.952326 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-9b957a9a-a727-43a0-9106-bc6186ba1aac req-cf50ec0b-f64a-41e8-958f-66843aea9a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ea6b56-5481-4605-b6df-ad8b3d7a1eb2", "name": "network-vif-plugged", "status": "completed", "tag": "f430032e-c17e-4c53-8b5f-6ac11189c17a"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:41.968699 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-9b957a9a-a727-43a0-9106-bc6186ba1aac req-cf50ec0b-f64a-41e8-958f-66843aea9a7d service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:41.969152 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-9b957a9a-a727-43a0-9106-bc6186ba1aac req-cf50ec0b-f64a-41e8-958f-66843aea9a7d service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:41.982684 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-9b957a9a-a727-43a0-9106-bc6186ba1aac req-cf50ec0b-f64a-41e8-958f-66843aea9a7d service nova] Creating event network-vif-plugged:f430032e-c17e-4c53-8b5f-6ac11189c17a for instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 on hv-cinder-73306 Aug 01 07:43:41.988252 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-9b957a9a-a727-43a0-9106-bc6186ba1aac req-cf50ec0b-f64a-41e8-958f-66843aea9a7d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042774 Aug 01 07:43:41.989557 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 444/870] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:42.026859 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-94216b50-2c84-45c0-83a0-36a5889fa51f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:42.027729 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-94216b50-2c84-45c0-83a0-36a5889fa51f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:42.035575 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-94216b50-2c84-45c0-83a0-36a5889fa51f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:42.036030 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-94216b50-2c84-45c0-83a0-36a5889fa51f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:42.036963 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-94216b50-2c84-45c0-83a0-36a5889fa51f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:42.037291 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-94216b50-2c84-45c0-83a0-36a5889fa51f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:42.185269 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-94216b50-2c84-45c0-83a0-36a5889fa51f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:42.194489 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-94216b50-2c84-45c0-83a0-36a5889fa51f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:42.196224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-94216b50-2c84-45c0-83a0-36a5889fa51f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:42.197395 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-94216b50-2c84-45c0-83a0-36a5889fa51f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1722 microversion: 2.20 time: 0.176331 Aug 01 07:43:42.198043 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 427/871] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:42 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:42.319850 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b5b3b860-bcfd-465f-8b9e-54f0ff9f16a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:42.320547 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b5b3b860-bcfd-465f-8b9e-54f0ff9f16a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:42.326628 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b5b3b860-bcfd-465f-8b9e-54f0ff9f16a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:42.327105 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b5b3b860-bcfd-465f-8b9e-54f0ff9f16a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:42.327868 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b5b3b860-bcfd-465f-8b9e-54f0ff9f16a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:42.328306 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b5b3b860-bcfd-465f-8b9e-54f0ff9f16a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:42.462331 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-b5b3b860-bcfd-465f-8b9e-54f0ff9f16a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:42.469856 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b5b3b860-bcfd-465f-8b9e-54f0ff9f16a1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.155783 Aug 01 07:43:42.470423 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 445/872] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:42 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:42.714232 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8b1a55ac-dfdd-4ef4-be4b-81b6b50caa0a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:42.714734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8b1a55ac-dfdd-4ef4-be4b-81b6b50caa0a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:42.721177 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8b1a55ac-dfdd-4ef4-be4b-81b6b50caa0a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:42.721782 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8b1a55ac-dfdd-4ef4-be4b-81b6b50caa0a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:42.722549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8b1a55ac-dfdd-4ef4-be4b-81b6b50caa0a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:42.722991 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8b1a55ac-dfdd-4ef4-be4b-81b6b50caa0a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:42.726958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:42.751452 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8b1a55ac-dfdd-4ef4-be4b-81b6b50caa0a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Going to try to terminate instance {{(pid=124280) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:43:42.823789 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8b1a55ac-dfdd-4ef4-be4b-81b6b50caa0a tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "DELETE /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 204 len: 0 microversion: 2.1 time: 0.113099 Aug 01 07:43:42.824356 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 428/873] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:43:42 2022] DELETE /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:43:42.832709 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c1c701d7-6773-433b-8554-b00324c89ffd tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:42.833325 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c1c701d7-6773-433b-8554-b00324c89ffd tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:42.839298 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c1c701d7-6773-433b-8554-b00324c89ffd tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:42.839743 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c1c701d7-6773-433b-8554-b00324c89ffd tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:42.840497 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c1c701d7-6773-433b-8554-b00324c89ffd tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:42.840935 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c1c701d7-6773-433b-8554-b00324c89ffd tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:42.970186 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c1c701d7-6773-433b-8554-b00324c89ffd tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:42.979418 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c1c701d7-6773-433b-8554-b00324c89ffd tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1555 microversion: 2.1 time: 0.150788 Aug 01 07:43:42.979972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 446/874] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:42 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:43.223724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-20f487f5-5750-4930-9afd-088853fa4510 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:43.224473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-20f487f5-5750-4930-9afd-088853fa4510 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:43.231509 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-20f487f5-5750-4930-9afd-088853fa4510 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:43.231977 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-20f487f5-5750-4930-9afd-088853fa4510 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:43.232873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-20f487f5-5750-4930-9afd-088853fa4510 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:43.233198 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-20f487f5-5750-4930-9afd-088853fa4510 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:43.385811 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-20f487f5-5750-4930-9afd-088853fa4510 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:43.394868 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-20f487f5-5750-4930-9afd-088853fa4510 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:43.396555 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-20f487f5-5750-4930-9afd-088853fa4510 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:43.397726 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-20f487f5-5750-4930-9afd-088853fa4510 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1722 microversion: 2.20 time: 0.179255 Aug 01 07:43:43.398285 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 429/875] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:43 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:43.490906 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-82099e95-6f7e-4e12-964a-9bfeda1bbd09 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:43.491491 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-82099e95-6f7e-4e12-964a-9bfeda1bbd09 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:43.498562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-82099e95-6f7e-4e12-964a-9bfeda1bbd09 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:43.499013 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-82099e95-6f7e-4e12-964a-9bfeda1bbd09 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:43.499807 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-82099e95-6f7e-4e12-964a-9bfeda1bbd09 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:43.500247 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-82099e95-6f7e-4e12-964a-9bfeda1bbd09 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:43.647645 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-82099e95-6f7e-4e12-964a-9bfeda1bbd09 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:43.655421 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-82099e95-6f7e-4e12-964a-9bfeda1bbd09 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.169155 Aug 01 07:43:43.656029 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 447/876] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:43 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:44.000104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d21cfb84-6624-417c-ac53-8b233549c498 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:44.000971 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d21cfb84-6624-417c-ac53-8b233549c498 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:44.007120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d21cfb84-6624-417c-ac53-8b233549c498 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:44.007576 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d21cfb84-6624-417c-ac53-8b233549c498 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:44.008336 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d21cfb84-6624-417c-ac53-8b233549c498 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:44.008768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d21cfb84-6624-417c-ac53-8b233549c498 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:44.139380 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d21cfb84-6624-417c-ac53-8b233549c498 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:44.147364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d21cfb84-6624-417c-ac53-8b233549c498 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1555 microversion: 2.1 time: 0.151147 Aug 01 07:43:44.147926 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 430/877] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:43 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:44.421524 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2fe3ce89-50c4-4c67-9746-6226efc190e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:44.422117 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2fe3ce89-50c4-4c67-9746-6226efc190e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:44.428503 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2fe3ce89-50c4-4c67-9746-6226efc190e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:44.428983 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2fe3ce89-50c4-4c67-9746-6226efc190e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:44.429740 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2fe3ce89-50c4-4c67-9746-6226efc190e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:44.430177 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2fe3ce89-50c4-4c67-9746-6226efc190e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:44.566023 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2fe3ce89-50c4-4c67-9746-6226efc190e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:44.574130 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2fe3ce89-50c4-4c67-9746-6226efc190e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:44.575651 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2fe3ce89-50c4-4c67-9746-6226efc190e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:44.577356 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2fe3ce89-50c4-4c67-9746-6226efc190e2 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1722 microversion: 2.20 time: 0.159783 Aug 01 07:43:44.577947 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 448/878] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:44 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:44.678085 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-86728424-496a-44aa-8fbe-1838c66f5f80 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:44.678691 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-86728424-496a-44aa-8fbe-1838c66f5f80 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:44.685148 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-86728424-496a-44aa-8fbe-1838c66f5f80 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:44.685605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-86728424-496a-44aa-8fbe-1838c66f5f80 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:44.686364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-86728424-496a-44aa-8fbe-1838c66f5f80 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:44.686800 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-86728424-496a-44aa-8fbe-1838c66f5f80 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:44.822621 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-86728424-496a-44aa-8fbe-1838c66f5f80 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:44.830014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-86728424-496a-44aa-8fbe-1838c66f5f80 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.156418 Aug 01 07:43:44.830569 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 431/879] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:44 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:45.168878 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-49399027-7b73-43af-bbc9-44c79cd6bae3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:45.169484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-49399027-7b73-43af-bbc9-44c79cd6bae3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:45.175485 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-49399027-7b73-43af-bbc9-44c79cd6bae3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:45.175959 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-49399027-7b73-43af-bbc9-44c79cd6bae3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:45.176898 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-49399027-7b73-43af-bbc9-44c79cd6bae3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:45.177337 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-49399027-7b73-43af-bbc9-44c79cd6bae3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:45.321160 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-49399027-7b73-43af-bbc9-44c79cd6bae3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:45.328947 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-49399027-7b73-43af-bbc9-44c79cd6bae3 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1555 microversion: 2.1 time: 0.163959 Aug 01 07:43:45.329693 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 449/880] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:45 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:45.601173 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c4fec732-fc54-45cd-ba0b-cf3fc4bd8524 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:45.601883 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c4fec732-fc54-45cd-ba0b-cf3fc4bd8524 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:45.607894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c4fec732-fc54-45cd-ba0b-cf3fc4bd8524 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:45.608526 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c4fec732-fc54-45cd-ba0b-cf3fc4bd8524 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:45.609296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c4fec732-fc54-45cd-ba0b-cf3fc4bd8524 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:45.609736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c4fec732-fc54-45cd-ba0b-cf3fc4bd8524 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:45.768919 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c4fec732-fc54-45cd-ba0b-cf3fc4bd8524 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:45.779056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c4fec732-fc54-45cd-ba0b-cf3fc4bd8524 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:45.780574 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c4fec732-fc54-45cd-ba0b-cf3fc4bd8524 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:45.781725 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c4fec732-fc54-45cd-ba0b-cf3fc4bd8524 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1725 microversion: 2.20 time: 0.184703 Aug 01 07:43:45.782287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 432/881] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:45 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:45.804621 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0d37a05a-f32c-4415-87c6-6d5283b9fbb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e63885c-aa5b-472f-bb18-8835047ad595"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:45.807058 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0d37a05a-f32c-4415-87c6-6d5283b9fbb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:45.813440 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0d37a05a-f32c-4415-87c6-6d5283b9fbb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:45.813882 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0d37a05a-f32c-4415-87c6-6d5283b9fbb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:45.814647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0d37a05a-f32c-4415-87c6-6d5283b9fbb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:45.815086 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0d37a05a-f32c-4415-87c6-6d5283b9fbb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:45.854650 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e3c03f2f-e8d4-45e7-996b-94fb95e6edb1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:45.855388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e3c03f2f-e8d4-45e7-996b-94fb95e6edb1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:45.863167 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e3c03f2f-e8d4-45e7-996b-94fb95e6edb1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:45.863167 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e3c03f2f-e8d4-45e7-996b-94fb95e6edb1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:45.864671 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e3c03f2f-e8d4-45e7-996b-94fb95e6edb1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:45.865124 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e3c03f2f-e8d4-45e7-996b-94fb95e6edb1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.092792 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e3c03f2f-e8d4-45e7-996b-94fb95e6edb1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:46.104602 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e3c03f2f-e8d4-45e7-996b-94fb95e6edb1 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.256131 Aug 01 07:43:46.118175 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 433/882] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:45 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:46.118175 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-6ab63784-da8f-4ed4-a58a-92d1088c3d4f req-5094f2dd-7b92-497d-a82e-3dcb63b805e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f30f324-1dcf-44b9-b81d-ef96811b0a87", "name": "network-vif-unplugged", "status": "completed", "tag": "23ceaa56-07cb-42cc-83de-2bfdae7aac98"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:46.140157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-6ab63784-da8f-4ed4-a58a-92d1088c3d4f req-5094f2dd-7b92-497d-a82e-3dcb63b805e3 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.140619 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-6ab63784-da8f-4ed4-a58a-92d1088c3d4f req-5094f2dd-7b92-497d-a82e-3dcb63b805e3 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.165538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.compute.server_external_events [req-6ab63784-da8f-4ed4-a58a-92d1088c3d4f req-5094f2dd-7b92-497d-a82e-3dcb63b805e3 service nova] Unable to find a host for instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87. Dropping event network-vif-unplugged {{(pid=124280) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 07:43:46.166459 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-6ab63784-da8f-4ed4-a58a-92d1088c3d4f req-5094f2dd-7b92-497d-a82e-3dcb63b805e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.059520 Aug 01 07:43:46.168502 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 434/883] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 01 07:43:46.250136 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0d37a05a-f32c-4415-87c6-6d5283b9fbb0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "POST /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.449501 Aug 01 07:43:46.251098 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 450/884] 10.222.0.40 () {62 vars in 1364 bytes} [Mon Aug 1 07:43:45 2022] POST /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/os-volume_attachments => generated 188 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:43:46.350725 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-508997be-b242-46cd-abe8-3a47c0a3163d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:46.351644 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-508997be-b242-46cd-abe8-3a47c0a3163d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:46.360809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-508997be-b242-46cd-abe8-3a47c0a3163d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.361130 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-508997be-b242-46cd-abe8-3a47c0a3163d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.362353 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-508997be-b242-46cd-abe8-3a47c0a3163d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.362906 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-508997be-b242-46cd-abe8-3a47c0a3163d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.406704 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ba06fb5a-956c-44f4-beed-3a5f1532a623 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:46.412325 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ba06fb5a-956c-44f4-beed-3a5f1532a623 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:46.419224 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba06fb5a-956c-44f4-beed-3a5f1532a623 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.419672 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba06fb5a-956c-44f4-beed-3a5f1532a623 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.420624 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba06fb5a-956c-44f4-beed-3a5f1532a623 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.421055 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba06fb5a-956c-44f4-beed-3a5f1532a623 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.579255 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-508997be-b242-46cd-abe8-3a47c0a3163d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:46.588067 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-508997be-b242-46cd-abe8-3a47c0a3163d tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1555 microversion: 2.1 time: 0.241077 Aug 01 07:43:46.596881 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 435/885] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:46 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:46.744164 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-d689dfa2-5f77-497b-b2ee-6ddc8252de84 req-c3e82744-bc59-4bf2-a664-a2cd2a81cb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587f64fe-aa07-43ef-942a-883dfa6b585c", "name": "network-vif-deleted", "tag": "2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:46.754647 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-d689dfa2-5f77-497b-b2ee-6ddc8252de84 req-c3e82744-bc59-4bf2-a664-a2cd2a81cb94 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.755228 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-d689dfa2-5f77-497b-b2ee-6ddc8252de84 req-c3e82744-bc59-4bf2-a664-a2cd2a81cb94 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.757639 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ba06fb5a-956c-44f4-beed-3a5f1532a623 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/os-volume_attachments/5e63885c-aa5b-472f-bb18-8835047ad595" status: 202 len: 0 microversion: 2.20 time: 0.355038 Aug 01 07:43:46.758462 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 451/886] 10.222.0.40 () {60 vars in 1457 bytes} [Mon Aug 1 07:43:46 2022] DELETE /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/os-volume_attachments/5e63885c-aa5b-472f-bb18-8835047ad595 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 07:43:46.770381 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-d689dfa2-5f77-497b-b2ee-6ddc8252de84 req-c3e82744-bc59-4bf2-a664-a2cd2a81cb94 service nova] Creating event network-vif-deleted:2b1d67d9-9386-4fb4-8ab5-4e2cecdf432f for instance 587f64fe-aa07-43ef-942a-883dfa6b585c on hv-cinder-73306 Aug 01 07:43:46.775671 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-d689dfa2-5f77-497b-b2ee-6ddc8252de84 req-c3e82744-bc59-4bf2-a664-a2cd2a81cb94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035337 Aug 01 07:43:46.776571 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 436/887] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:46.831058 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8ea4e45e-ef6b-48ba-a9ad-a383bc0005b8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:46.831669 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8ea4e45e-ef6b-48ba-a9ad-a383bc0005b8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:46.838492 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8ea4e45e-ef6b-48ba-a9ad-a383bc0005b8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.838946 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8ea4e45e-ef6b-48ba-a9ad-a383bc0005b8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.839747 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8ea4e45e-ef6b-48ba-a9ad-a383bc0005b8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.840187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8ea4e45e-ef6b-48ba-a9ad-a383bc0005b8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.865564 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-26aac520-43da-404d-b0f4-fd6ab61c3513 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:46.868747 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-26aac520-43da-404d-b0f4-fd6ab61c3513 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:46.876309 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-26aac520-43da-404d-b0f4-fd6ab61c3513 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.877003 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-26aac520-43da-404d-b0f4-fd6ab61c3513 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.878093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-26aac520-43da-404d-b0f4-fd6ab61c3513 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.878906 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-26aac520-43da-404d-b0f4-fd6ab61c3513 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.891094 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8ea4e45e-ef6b-48ba-a9ad-a383bc0005b8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124279) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 07:43:46.911700 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-26aac520-43da-404d-b0f4-fd6ab61c3513 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051506 Aug 01 07:43:46.912276 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 437/888] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:43:46 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:46.922640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-22b9f47d-3c6e-439e-8aab-7514a6d14471 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:46.923039 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-22b9f47d-3c6e-439e-8aab-7514a6d14471 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:46.929772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-22b9f47d-3c6e-439e-8aab-7514a6d14471 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.930821 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-22b9f47d-3c6e-439e-8aab-7514a6d14471 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.931104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-22b9f47d-3c6e-439e-8aab-7514a6d14471 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:46.931524 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-22b9f47d-3c6e-439e-8aab-7514a6d14471 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:46.980710 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-22b9f47d-3c6e-439e-8aab-7514a6d14471 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments/7a2a12bd-e86e-4b20-b285-71a326d876dd" status: 200 len: 194 microversion: 2.1 time: 0.061845 Aug 01 07:43:46.981725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8ea4e45e-ef6b-48ba-a9ad-a383bc0005b8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "POST /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/action" status: 202 len: 0 microversion: 2.20 time: 0.154476 Aug 01 07:43:46.982344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 452/889] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Aug 1 07:43:46 2022] POST /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:43:46.994682 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e0719cc3-89b5-432c-a0cf-eda9da45b402 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:46.995433 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e0719cc3-89b5-432c-a0cf-eda9da45b402 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:46.997401 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 438/890] 10.222.0.40 () {58 vars in 1413 bytes} [Mon Aug 1 07:43:46 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments/7a2a12bd-e86e-4b20-b285-71a326d876dd => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:43:47.002379 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e0719cc3-89b5-432c-a0cf-eda9da45b402 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:47.003326 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e0719cc3-89b5-432c-a0cf-eda9da45b402 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:47.005499 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e0719cc3-89b5-432c-a0cf-eda9da45b402 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:47.006131 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e0719cc3-89b5-432c-a0cf-eda9da45b402 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:47.038875 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:47.126688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9d2f8b73-02b9-49f5-a37b-2ebd11f4d394 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:47.127626 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9d2f8b73-02b9-49f5-a37b-2ebd11f4d394 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:47.142014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9d2f8b73-02b9-49f5-a37b-2ebd11f4d394 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:47.146434 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9d2f8b73-02b9-49f5-a37b-2ebd11f4d394 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:47.149010 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9d2f8b73-02b9-49f5-a37b-2ebd11f4d394 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:47.149943 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9d2f8b73-02b9-49f5-a37b-2ebd11f4d394 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:47.261928 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e0719cc3-89b5-432c-a0cf-eda9da45b402 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:47.273801 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e0719cc3-89b5-432c-a0cf-eda9da45b402 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:47.275422 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-e0719cc3-89b5-432c-a0cf-eda9da45b402 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:47.276633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e0719cc3-89b5-432c-a0cf-eda9da45b402 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1673 microversion: 2.20 time: 0.289876 Aug 01 07:43:47.291904 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 453/891] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:46 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:43:47.397975 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-9d2f8b73-02b9-49f5-a37b-2ebd11f4d394 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:47.407109 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9d2f8b73-02b9-49f5-a37b-2ebd11f4d394 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1266 microversion: 2.1 time: 0.285168 Aug 01 07:43:47.408077 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 439/892] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:47 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:47.610501 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:47.616167 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:47.619668 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:47.623715 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:47.634056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:47.635210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:47.635682 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:47.680860 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:47.681102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:47.681553 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lazy-loading 'fault' on Instance uuid 587f64fe-aa07-43ef-942a-883dfa6b585c {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:43:47.733167 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e461e65817648b0a878d8280c84dc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27abd6ed13c4174a4c14226fb48e146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:47.742180 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-38953c0b-6c96-4065-b1d6-a5cadf87520f tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 200 len: 1349 microversion: 2.1 time: 0.136250 Aug 01 07:43:47.743094 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 454/893] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:47 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 1349 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:48.303016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3920e450-6ff1-4f58-a2e3-c1a4651be720 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:48.304171 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3920e450-6ff1-4f58-a2e3-c1a4651be720 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:48.336410 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3920e450-6ff1-4f58-a2e3-c1a4651be720 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:48.336934 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3920e450-6ff1-4f58-a2e3-c1a4651be720 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:48.337658 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3920e450-6ff1-4f58-a2e3-c1a4651be720 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:48.338415 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3920e450-6ff1-4f58-a2e3-c1a4651be720 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:48.429016 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7d3b87fa-8466-47ce-b55f-f015a2e785bf tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:48.429629 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7d3b87fa-8466-47ce-b55f-f015a2e785bf tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:48.436396 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7d3b87fa-8466-47ce-b55f-f015a2e785bf tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:48.436854 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7d3b87fa-8466-47ce-b55f-f015a2e785bf tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:48.437667 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7d3b87fa-8466-47ce-b55f-f015a2e785bf tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:48.438125 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7d3b87fa-8466-47ce-b55f-f015a2e785bf tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:48.502932 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3920e450-6ff1-4f58-a2e3-c1a4651be720 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:48.511093 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3920e450-6ff1-4f58-a2e3-c1a4651be720 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:48.512618 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3920e450-6ff1-4f58-a2e3-c1a4651be720 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:48.513784 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3920e450-6ff1-4f58-a2e3-c1a4651be720 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.216338 Aug 01 07:43:48.514342 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 440/894] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:48 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:48.519177 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-121843d4-a629-4e4d-b057-dc97c205ac4c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10f302ae-4ec2-4cd2-987a-66715b018071"}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:48.522502 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-121843d4-a629-4e4d-b057-dc97c205ac4c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:48.528878 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-121843d4-a629-4e4d-b057-dc97c205ac4c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:48.529335 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-121843d4-a629-4e4d-b057-dc97c205ac4c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:48.530116 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-121843d4-a629-4e4d-b057-dc97c205ac4c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:48.530560 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-121843d4-a629-4e4d-b057-dc97c205ac4c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:48.581543 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7d3b87fa-8466-47ce-b55f-f015a2e785bf tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:48.589777 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7d3b87fa-8466-47ce-b55f-f015a2e785bf tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1452 microversion: 2.1 time: 0.164820 Aug 01 07:43:48.590348 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 455/895] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:48 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:43:48.610862 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2c530efb-a9f3-4950-8b61-f439bf2fd047 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:48.611512 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2c530efb-a9f3-4950-8b61-f439bf2fd047 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:48.617627 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2c530efb-a9f3-4950-8b61-f439bf2fd047 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:48.618087 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2c530efb-a9f3-4950-8b61-f439bf2fd047 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:48.618845 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2c530efb-a9f3-4950-8b61-f439bf2fd047 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:48.619305 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2c530efb-a9f3-4950-8b61-f439bf2fd047 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:48.784364 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2c530efb-a9f3-4950-8b61-f439bf2fd047 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:48.793462 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2c530efb-a9f3-4950-8b61-f439bf2fd047 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1452 microversion: 2.1 time: 0.186456 Aug 01 07:43:48.794040 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 456/896] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:48 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:43:48.798472 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-aa0c0eba-31b7-4324-a910-fbf96ee044e7 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:48.799336 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-aa0c0eba-31b7-4324-a910-fbf96ee044e7 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] [instance: 587f64fe-aa07-43ef-942a-883dfa6b585c] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:48.813108 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-121843d4-a629-4e4d-b057-dc97c205ac4c tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "POST /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297456 Aug 01 07:43:48.813761 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 441/897] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:43:48 2022] POST /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:43:48.824726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa0c0eba-31b7-4324-a910-fbf96ee044e7 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:48.824726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa0c0eba-31b7-4324-a910-fbf96ee044e7 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:48.825009 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa0c0eba-31b7-4324-a910-fbf96ee044e7 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:48.825541 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aa0c0eba-31b7-4324-a910-fbf96ee044e7 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:48.843158 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-aa0c0eba-31b7-4324-a910-fbf96ee044e7 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] HTTP exception thrown: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c could not be found. Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-aa0c0eba-31b7-4324-a910-fbf96ee044e7 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Request method failure captured: Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c HTTP/1.1 Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54OHmxFcP1JGpeXxgfC24C0JMOfprswQ4yLa7cGf6uh-tp_AG4QjW6b7o-j5j9aFH0J7giFrqxhJJRq04hJ5SjyVhJT2ib35I5fZy4cTo39X8c5AwV6x9MWuy8XWq4TAwtSJPN6uwLpYfYVibW4cvSNwrZgY3wXsOJMv7HshCdbThHE Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: a27abd6ed13c4174a4c14226fb48e146 Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-TestMinimumBasicScenario-215761294 Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:43:48.846036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a27abd6ed13c4174a4c14226fb48e146"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a27abd6ed13c4174a4c14226fb48e146"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a27abd6ed13c4174a4c14226fb48e146"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a27abd6ed13c4174a4c14226fb48e146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-TestMinimumBasicScenario-215761294 Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: a27abd6ed13c4174a4c14226fb48e146 Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-TestMinimumBasicScenario-215761294 Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-TestMinimumBasicScenario-215761294-project Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 6e461e65817648b0a878d8280c84dc6e Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-TestMinimumBasicScenario-215761294-project Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c could not be found. Aug 01 07:43:48.848155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '587f64fe-aa07-43ef-942a-883dfa6b585c'} Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c could not be found. Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:43:48.849244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c could not be found. Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c could not be found. Aug 01 07:43:48.850677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:43:48.852996 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-aa0c0eba-31b7-4324-a910-fbf96ee044e7 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Returning 404 to user: Instance 587f64fe-aa07-43ef-942a-883dfa6b585c could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:43:48.854301 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-aa0c0eba-31b7-4324-a910-fbf96ee044e7 tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c" status: 404 len: 111 microversion: 2.1 time: 0.059342 Aug 01 07:43:48.855378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 457/898] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:43:48 2022] GET /compute/v2.1/servers/587f64fe-aa07-43ef-942a-883dfa6b585c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:43:48.866269 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-bd5fb03a-c77b-4c1c-b57e-1f4903affe3b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] Calling method '.version_select at 0x7fd018992430>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:48.915106 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-bd5fb03a-c77b-4c1c-b57e-1f4903affe3b tempest-TestMinimumBasicScenario-215761294 tempest-TestMinimumBasicScenario-215761294-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1364658719" status: 202 len: 0 microversion: 2.1 time: 0.047709 Aug 01 07:43:48.915106 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 442/899] 10.222.0.40 () {58 vars in 1272 bytes} [Mon Aug 1 07:43:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1364658719 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:43:49.538059 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6a9df446-90d0-43dc-802b-6f77a12e6f6f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:49.538666 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6a9df446-90d0-43dc-802b-6f77a12e6f6f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:49.556675 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6a9df446-90d0-43dc-802b-6f77a12e6f6f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:49.559256 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6a9df446-90d0-43dc-802b-6f77a12e6f6f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:49.560056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6a9df446-90d0-43dc-802b-6f77a12e6f6f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:49.560495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6a9df446-90d0-43dc-802b-6f77a12e6f6f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:50.225988 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6a9df446-90d0-43dc-802b-6f77a12e6f6f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:50.240971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6a9df446-90d0-43dc-802b-6f77a12e6f6f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:50.242691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6a9df446-90d0-43dc-802b-6f77a12e6f6f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:50.248465 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6a9df446-90d0-43dc-802b-6f77a12e6f6f tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.714609 Aug 01 07:43:50.259763 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 458/900] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:49 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:51.281316 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-bdcdac75-9f7f-4425-95d6-b1deb7969091 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:51.282062 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-bdcdac75-9f7f-4425-95d6-b1deb7969091 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:51.306395 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bdcdac75-9f7f-4425-95d6-b1deb7969091 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:51.319104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bdcdac75-9f7f-4425-95d6-b1deb7969091 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:51.319104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bdcdac75-9f7f-4425-95d6-b1deb7969091 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:51.319104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-bdcdac75-9f7f-4425-95d6-b1deb7969091 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:51.591466 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-a247de9b-aea4-4110-aeea-8935938ea66f req-756ba9e4-7134-45a4-947b-a14e99e620fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ea6b56-5481-4605-b6df-ad8b3d7a1eb2", "tag": "f430032e-c17e-4c53-8b5f-6ac11189c17a"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:43:51.621074 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-a247de9b-aea4-4110-aeea-8935938ea66f req-756ba9e4-7134-45a4-947b-a14e99e620fa service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:51.621539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-a247de9b-aea4-4110-aeea-8935938ea66f req-756ba9e4-7134-45a4-947b-a14e99e620fa service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:51.652322 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-a247de9b-aea4-4110-aeea-8935938ea66f req-756ba9e4-7134-45a4-947b-a14e99e620fa service nova] Creating event network-changed:f430032e-c17e-4c53-8b5f-6ac11189c17a for instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 on hv-cinder-73306 Aug 01 07:43:51.658852 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-a247de9b-aea4-4110-aeea-8935938ea66f req-756ba9e4-7134-45a4-947b-a14e99e620fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071949 Aug 01 07:43:51.660320 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 459/901] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:43:51.670155 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-bdcdac75-9f7f-4425-95d6-b1deb7969091 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:51.705394 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-bdcdac75-9f7f-4425-95d6-b1deb7969091 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:51.711374 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-bdcdac75-9f7f-4425-95d6-b1deb7969091 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:51.715287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-bdcdac75-9f7f-4425-95d6-b1deb7969091 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.438081 Aug 01 07:43:51.718809 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 443/902] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:51 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:52.746058 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8fda8d7c-f525-49fc-8e90-0dce55037c11 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:52.746758 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8fda8d7c-f525-49fc-8e90-0dce55037c11 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:52.763286 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8fda8d7c-f525-49fc-8e90-0dce55037c11 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:52.764049 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8fda8d7c-f525-49fc-8e90-0dce55037c11 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:52.764813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8fda8d7c-f525-49fc-8e90-0dce55037c11 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:52.765295 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8fda8d7c-f525-49fc-8e90-0dce55037c11 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:53.093854 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8fda8d7c-f525-49fc-8e90-0dce55037c11 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:53.103854 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8fda8d7c-f525-49fc-8e90-0dce55037c11 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:53.114220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8fda8d7c-f525-49fc-8e90-0dce55037c11 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:53.120721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8fda8d7c-f525-49fc-8e90-0dce55037c11 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.378893 Aug 01 07:43:53.124482 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 460/903] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:52 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:54.153042 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6dc3e0a0-4e67-4146-a7a9-08b6fa1bf8ce tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:54.153881 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6dc3e0a0-4e67-4146-a7a9-08b6fa1bf8ce tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:54.187211 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6dc3e0a0-4e67-4146-a7a9-08b6fa1bf8ce tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:54.191346 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6dc3e0a0-4e67-4146-a7a9-08b6fa1bf8ce tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:54.196213 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6dc3e0a0-4e67-4146-a7a9-08b6fa1bf8ce tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:54.198834 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6dc3e0a0-4e67-4146-a7a9-08b6fa1bf8ce tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:54.213924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:43:54.699811 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6dc3e0a0-4e67-4146-a7a9-08b6fa1bf8ce tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:54.721364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6dc3e0a0-4e67-4146-a7a9-08b6fa1bf8ce tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:54.725532 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6dc3e0a0-4e67-4146-a7a9-08b6fa1bf8ce tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:54.726741 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6dc3e0a0-4e67-4146-a7a9-08b6fa1bf8ce tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.580694 Aug 01 07:43:54.728978 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 444/904] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:54 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:55.751133 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ec172039-9269-4a26-a103-c2b4fd4f27a8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:55.751753 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ec172039-9269-4a26-a103-c2b4fd4f27a8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:55.769881 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ec172039-9269-4a26-a103-c2b4fd4f27a8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:55.772094 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ec172039-9269-4a26-a103-c2b4fd4f27a8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:55.773160 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ec172039-9269-4a26-a103-c2b4fd4f27a8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:55.779808 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ec172039-9269-4a26-a103-c2b4fd4f27a8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:56.184613 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ec172039-9269-4a26-a103-c2b4fd4f27a8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:56.196790 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ec172039-9269-4a26-a103-c2b4fd4f27a8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:56.199229 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ec172039-9269-4a26-a103-c2b4fd4f27a8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:56.200860 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ec172039-9269-4a26-a103-c2b4fd4f27a8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.454523 Aug 01 07:43:56.201780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 461/905] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:55 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:57.231121 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b30373c7-393e-4f99-b5eb-1f4079d40e06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:57.231743 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b30373c7-393e-4f99-b5eb-1f4079d40e06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:57.239598 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b30373c7-393e-4f99-b5eb-1f4079d40e06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:57.241855 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b30373c7-393e-4f99-b5eb-1f4079d40e06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:57.242706 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b30373c7-393e-4f99-b5eb-1f4079d40e06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:57.245012 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b30373c7-393e-4f99-b5eb-1f4079d40e06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:57.614205 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b30373c7-393e-4f99-b5eb-1f4079d40e06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:57.626673 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b30373c7-393e-4f99-b5eb-1f4079d40e06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:57.629881 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b30373c7-393e-4f99-b5eb-1f4079d40e06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:57.635969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b30373c7-393e-4f99-b5eb-1f4079d40e06 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.410787 Aug 01 07:43:57.652909 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 445/906] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:57 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:58.666060 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3f6c0b0d-9a7e-4f08-8d2e-3489de17ff53 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:58.667470 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3f6c0b0d-9a7e-4f08-8d2e-3489de17ff53 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:58.675929 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f6c0b0d-9a7e-4f08-8d2e-3489de17ff53 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:58.676583 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f6c0b0d-9a7e-4f08-8d2e-3489de17ff53 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:58.677584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f6c0b0d-9a7e-4f08-8d2e-3489de17ff53 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:58.678354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3f6c0b0d-9a7e-4f08-8d2e-3489de17ff53 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:58.921867 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3f6c0b0d-9a7e-4f08-8d2e-3489de17ff53 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:58.936413 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3f6c0b0d-9a7e-4f08-8d2e-3489de17ff53 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:58.939702 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3f6c0b0d-9a7e-4f08-8d2e-3489de17ff53 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:43:58.943196 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3f6c0b0d-9a7e-4f08-8d2e-3489de17ff53 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.282854 Aug 01 07:43:58.944288 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 462/907] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:58 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:43:59.971539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-deda0036-d2c4-4f31-a49e-021afba472f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:43:59.972400 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-deda0036-d2c4-4f31-a49e-021afba472f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:43:59.983369 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-deda0036-d2c4-4f31-a49e-021afba472f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:59.983823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-deda0036-d2c4-4f31-a49e-021afba472f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:43:59.984597 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-deda0036-d2c4-4f31-a49e-021afba472f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:43:59.985031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-deda0036-d2c4-4f31-a49e-021afba472f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:00.210776 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-deda0036-d2c4-4f31-a49e-021afba472f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:00.227126 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-deda0036-d2c4-4f31-a49e-021afba472f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:00.227126 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-deda0036-d2c4-4f31-a49e-021afba472f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:00.227126 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-deda0036-d2c4-4f31-a49e-021afba472f0 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.258263 Aug 01 07:44:00.227531 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 446/908] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:43:59 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:44:00.236046 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e041f9bd-4ee4-4152-a5d5-077e07f8884a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:00.239469 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e041f9bd-4ee4-4152-a5d5-077e07f8884a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:00.251056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e041f9bd-4ee4-4152-a5d5-077e07f8884a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:00.251056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e041f9bd-4ee4-4152-a5d5-077e07f8884a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:00.251056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e041f9bd-4ee4-4152-a5d5-077e07f8884a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:00.251056 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e041f9bd-4ee4-4152-a5d5-077e07f8884a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:00.295393 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e041f9bd-4ee4-4152-a5d5-077e07f8884a tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.065099 Aug 01 07:44:00.301533 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 463/909] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:44:00 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:44:00.723578 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a045cabe-4f6c-4042-a6fd-64824d71570d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:00.724143 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a045cabe-4f6c-4042-a6fd-64824d71570d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:00.733758 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a045cabe-4f6c-4042-a6fd-64824d71570d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:00.734220 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a045cabe-4f6c-4042-a6fd-64824d71570d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:00.735012 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a045cabe-4f6c-4042-a6fd-64824d71570d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:00.735680 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a045cabe-4f6c-4042-a6fd-64824d71570d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:00.773901 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a045cabe-4f6c-4042-a6fd-64824d71570d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments/7a2a12bd-e86e-4b20-b285-71a326d876dd" status: 200 len: 194 microversion: 2.1 time: 0.064940 Aug 01 07:44:00.774874 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 447/910] 10.222.0.40 () {58 vars in 1413 bytes} [Mon Aug 1 07:44:00 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments/7a2a12bd-e86e-4b20-b285-71a326d876dd => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:44:00.785546 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7b1941dd-b789-492b-a73a-791b81be9d91 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:00.786042 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7b1941dd-b789-492b-a73a-791b81be9d91 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:00.792181 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b1941dd-b789-492b-a73a-791b81be9d91 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:00.792854 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b1941dd-b789-492b-a73a-791b81be9d91 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:00.793807 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b1941dd-b789-492b-a73a-791b81be9d91 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:00.794252 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b1941dd-b789-492b-a73a-791b81be9d91 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:00.906500 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-7b1941dd-b789-492b-a73a-791b81be9d91 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lazy-loading 'services' on Instance uuid da493896-a5f9-4d76-95d6-52a82e82993e {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:44:00.997350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7b1941dd-b789-492b-a73a-791b81be9d91 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "DELETE /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments/7a2a12bd-e86e-4b20-b285-71a326d876dd" status: 202 len: 0 microversion: 2.1 time: 0.215821 Aug 01 07:44:00.998619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 464/911] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:44:00 2022] DELETE /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments/7a2a12bd-e86e-4b20-b285-71a326d876dd => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:44:01.250726 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5d1ebd63-2956-49d1-af0e-8d1a74903d81 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:01.251379 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5d1ebd63-2956-49d1-af0e-8d1a74903d81 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:01.261579 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5d1ebd63-2956-49d1-af0e-8d1a74903d81 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:01.262041 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5d1ebd63-2956-49d1-af0e-8d1a74903d81 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:01.263107 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5d1ebd63-2956-49d1-af0e-8d1a74903d81 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:01.263569 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5d1ebd63-2956-49d1-af0e-8d1a74903d81 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:01.412900 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5d1ebd63-2956-49d1-af0e-8d1a74903d81 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:01.423455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5d1ebd63-2956-49d1-af0e-8d1a74903d81 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:01.426199 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-5d1ebd63-2956-49d1-af0e-8d1a74903d81 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:01.427984 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5d1ebd63-2956-49d1-af0e-8d1a74903d81 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.181890 Aug 01 07:44:01.428591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 448/912] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:01 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:44:02.197224 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e015e7bb-3d9c-4f9e-a054-47eace40cae4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:02.199663 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e015e7bb-3d9c-4f9e-a054-47eace40cae4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:02.209247 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e015e7bb-3d9c-4f9e-a054-47eace40cae4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:02.210089 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e015e7bb-3d9c-4f9e-a054-47eace40cae4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:02.211191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e015e7bb-3d9c-4f9e-a054-47eace40cae4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:02.212004 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e015e7bb-3d9c-4f9e-a054-47eace40cae4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:02.245739 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e015e7bb-3d9c-4f9e-a054-47eace40cae4 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments/10f302ae-4ec2-4cd2-987a-66715b018071" status: 200 len: 194 microversion: 2.1 time: 0.053227 Aug 01 07:44:02.252541 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 465/913] 10.222.0.40 () {58 vars in 1413 bytes} [Mon Aug 1 07:44:02 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments/10f302ae-4ec2-4cd2-987a-66715b018071 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:44:02.257938 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1c75d9c1-c916-49a4-9348-944fa2bed24b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:02.258444 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1c75d9c1-c916-49a4-9348-944fa2bed24b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:02.264833 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1c75d9c1-c916-49a4-9348-944fa2bed24b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:02.265376 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1c75d9c1-c916-49a4-9348-944fa2bed24b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:02.266161 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1c75d9c1-c916-49a4-9348-944fa2bed24b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:02.266599 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1c75d9c1-c916-49a4-9348-944fa2bed24b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:02.365104 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-1c75d9c1-c916-49a4-9348-944fa2bed24b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lazy-loading 'services' on Instance uuid da493896-a5f9-4d76-95d6-52a82e82993e {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:44:02.450603 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-64eace63-7543-433f-aca9-7edc9c886e5d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:02.451941 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-64eace63-7543-433f-aca9-7edc9c886e5d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:02.462102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-64eace63-7543-433f-aca9-7edc9c886e5d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:02.466485 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-64eace63-7543-433f-aca9-7edc9c886e5d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:02.467908 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-64eace63-7543-433f-aca9-7edc9c886e5d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:02.468457 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-64eace63-7543-433f-aca9-7edc9c886e5d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:02.469020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1c75d9c1-c916-49a4-9348-944fa2bed24b tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "DELETE /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments/10f302ae-4ec2-4cd2-987a-66715b018071" status: 202 len: 0 microversion: 2.1 time: 0.215799 Aug 01 07:44:02.473300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 449/914] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:44:02 2022] DELETE /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments/10f302ae-4ec2-4cd2-987a-66715b018071 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:44:02.684896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-64eace63-7543-433f-aca9-7edc9c886e5d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:02.693519 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-64eace63-7543-433f-aca9-7edc9c886e5d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:02.695034 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-64eace63-7543-433f-aca9-7edc9c886e5d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:02.696300 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-64eace63-7543-433f-aca9-7edc9c886e5d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.250108 Aug 01 07:44:02.697140 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 466/915] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:02 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:44:03.703565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-24cfde62-7fba-4b90-af9b-92e3541b5578 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:03.706055 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-24cfde62-7fba-4b90-af9b-92e3541b5578 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:03.712880 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-24cfde62-7fba-4b90-af9b-92e3541b5578 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:03.713560 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-24cfde62-7fba-4b90-af9b-92e3541b5578 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:03.714351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-24cfde62-7fba-4b90-af9b-92e3541b5578 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:03.714965 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-24cfde62-7fba-4b90-af9b-92e3541b5578 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:03.719372 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-77b60877-c217-41ef-a184-9e31d9fce8f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:03.719992 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-77b60877-c217-41ef-a184-9e31d9fce8f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:03.728221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77b60877-c217-41ef-a184-9e31d9fce8f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:03.728679 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77b60877-c217-41ef-a184-9e31d9fce8f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:03.729458 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77b60877-c217-41ef-a184-9e31d9fce8f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:03.730083 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-77b60877-c217-41ef-a184-9e31d9fce8f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:03.748424 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-24cfde62-7fba-4b90-af9b-92e3541b5578 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049510 Aug 01 07:44:03.749298 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 450/916] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:44:03 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 07:44:03.889524 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-dfde968f-a36f-4096-aeb2-19b56bdf6a48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:03.892816 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-dfde968f-a36f-4096-aeb2-19b56bdf6a48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:03.899748 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dfde968f-a36f-4096-aeb2-19b56bdf6a48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:03.900277 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dfde968f-a36f-4096-aeb2-19b56bdf6a48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:03.901180 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dfde968f-a36f-4096-aeb2-19b56bdf6a48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:03.901688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-dfde968f-a36f-4096-aeb2-19b56bdf6a48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:03.907267 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-77b60877-c217-41ef-a184-9e31d9fce8f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:03.917958 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-77b60877-c217-41ef-a184-9e31d9fce8f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:03.919500 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-77b60877-c217-41ef-a184-9e31d9fce8f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:03.920721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-77b60877-c217-41ef-a184-9e31d9fce8f8 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.205179 Aug 01 07:44:03.921270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 467/917] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:03 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:44:03.944127 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-dfde968f-a36f-4096-aeb2-19b56bdf6a48 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058606 Aug 01 07:44:03.952096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 451/918] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:44:03 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 07:44:04.020356 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-76a5b120-5876-46ee-8686-a156bb39edbc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:04.020356 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-76a5b120-5876-46ee-8686-a156bb39edbc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:04.030741 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-76a5b120-5876-46ee-8686-a156bb39edbc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:04.031379 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-76a5b120-5876-46ee-8686-a156bb39edbc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:04.033560 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-76a5b120-5876-46ee-8686-a156bb39edbc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:04.033560 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-76a5b120-5876-46ee-8686-a156bb39edbc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:04.067558 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-76a5b120-5876-46ee-8686-a156bb39edbc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:44:04.108645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-3df863b3-890d-48cf-a906-6162813d2567 req-d8a5a829-e6ad-4899-b6b6-c3dce9edf923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f30f324-1dcf-44b9-b81d-ef96811b0a87", "name": "network-vif-plugged", "status": "completed", "tag": "23ceaa56-07cb-42cc-83de-2bfdae7aac98"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:44:04.129670 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-3df863b3-890d-48cf-a906-6162813d2567 req-d8a5a829-e6ad-4899-b6b6-c3dce9edf923 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:04.132561 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-3df863b3-890d-48cf-a906-6162813d2567 req-d8a5a829-e6ad-4899-b6b6-c3dce9edf923 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:04.153381 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-3df863b3-890d-48cf-a906-6162813d2567 req-d8a5a829-e6ad-4899-b6b6-c3dce9edf923 service nova] Creating event network-vif-plugged:23ceaa56-07cb-42cc-83de-2bfdae7aac98 for instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 on hv-cinder-73306 Aug 01 07:44:04.160571 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-3df863b3-890d-48cf-a906-6162813d2567 req-d8a5a829-e6ad-4899-b6b6-c3dce9edf923 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058100 Aug 01 07:44:04.161888 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 452/919] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:44:04.238067 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:04.274038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-76a5b120-5876-46ee-8686-a156bb39edbc tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "DELETE /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 204 len: 0 microversion: 2.1 time: 0.258761 Aug 01 07:44:04.275377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 468/920] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:44:04 2022] DELETE /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:44:04.285973 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-da695e30-c1ce-447e-ac5b-7e504ab5c313 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:04.286974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-da695e30-c1ce-447e-ac5b-7e504ab5c313 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:04.296237 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da695e30-c1ce-447e-ac5b-7e504ab5c313 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:04.296727 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da695e30-c1ce-447e-ac5b-7e504ab5c313 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:04.297557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da695e30-c1ce-447e-ac5b-7e504ab5c313 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:04.298317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da695e30-c1ce-447e-ac5b-7e504ab5c313 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:04.441308 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-da695e30-c1ce-447e-ac5b-7e504ab5c313 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:04.449449 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-da695e30-c1ce-447e-ac5b-7e504ab5c313 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1671 microversion: 2.1 time: 0.169353 Aug 01 07:44:04.450012 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 453/921] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:04 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:04.945115 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-86d60cd0-6f34-4421-b6fa-5178c643b778 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:04.945930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-86d60cd0-6f34-4421-b6fa-5178c643b778 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:04.953043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-86d60cd0-6f34-4421-b6fa-5178c643b778 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:04.953702 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-86d60cd0-6f34-4421-b6fa-5178c643b778 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:04.954469 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-86d60cd0-6f34-4421-b6fa-5178c643b778 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:04.954902 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-86d60cd0-6f34-4421-b6fa-5178c643b778 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:05.092816 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-86d60cd0-6f34-4421-b6fa-5178c643b778 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:05.101883 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-86d60cd0-6f34-4421-b6fa-5178c643b778 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:05.103407 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-86d60cd0-6f34-4421-b6fa-5178c643b778 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:05.104565 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-86d60cd0-6f34-4421-b6fa-5178c643b778 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.164329 Aug 01 07:44:05.105122 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 469/922] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:04 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:44:05.469824 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d3834d53-db6a-414d-b950-e4d6e761b086 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:05.470431 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d3834d53-db6a-414d-b950-e4d6e761b086 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:05.477022 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3834d53-db6a-414d-b950-e4d6e761b086 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:05.477502 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3834d53-db6a-414d-b950-e4d6e761b086 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:05.478269 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3834d53-db6a-414d-b950-e4d6e761b086 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:05.478715 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d3834d53-db6a-414d-b950-e4d6e761b086 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:05.612718 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d3834d53-db6a-414d-b950-e4d6e761b086 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:05.621021 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d3834d53-db6a-414d-b950-e4d6e761b086 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1671 microversion: 2.1 time: 0.154923 Aug 01 07:44:05.621643 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 454/923] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:05 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:06.128486 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ba2fbc44-2704-4f7d-ac00-8a9c3c321f47 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:06.129100 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ba2fbc44-2704-4f7d-ac00-8a9c3c321f47 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:06.135478 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba2fbc44-2704-4f7d-ac00-8a9c3c321f47 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:06.136062 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba2fbc44-2704-4f7d-ac00-8a9c3c321f47 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:06.136839 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba2fbc44-2704-4f7d-ac00-8a9c3c321f47 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:06.137355 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba2fbc44-2704-4f7d-ac00-8a9c3c321f47 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:06.292996 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ba2fbc44-2704-4f7d-ac00-8a9c3c321f47 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:06.302027 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ba2fbc44-2704-4f7d-ac00-8a9c3c321f47 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:06.303728 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ba2fbc44-2704-4f7d-ac00-8a9c3c321f47 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:06.305119 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ba2fbc44-2704-4f7d-ac00-8a9c3c321f47 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.181416 Aug 01 07:44:06.305752 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 470/924] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:06 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:44:06.643981 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-544eaaae-e93e-4b61-a5e2-8e99576af053 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:06.644695 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-544eaaae-e93e-4b61-a5e2-8e99576af053 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:06.651266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-544eaaae-e93e-4b61-a5e2-8e99576af053 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:06.651801 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-544eaaae-e93e-4b61-a5e2-8e99576af053 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:06.652584 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-544eaaae-e93e-4b61-a5e2-8e99576af053 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:06.653029 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-544eaaae-e93e-4b61-a5e2-8e99576af053 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:06.917131 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-544eaaae-e93e-4b61-a5e2-8e99576af053 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:06.927164 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-544eaaae-e93e-4b61-a5e2-8e99576af053 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1671 microversion: 2.1 time: 0.287005 Aug 01 07:44:06.928050 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 455/925] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:06 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1671 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:07.330268 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a707e1fd-cad7-492b-ae90-0ef1b95243b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:07.332731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a707e1fd-cad7-492b-ae90-0ef1b95243b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:07.339584 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a707e1fd-cad7-492b-ae90-0ef1b95243b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:07.340303 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a707e1fd-cad7-492b-ae90-0ef1b95243b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:07.341288 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a707e1fd-cad7-492b-ae90-0ef1b95243b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:07.341912 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a707e1fd-cad7-492b-ae90-0ef1b95243b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:07.516649 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a707e1fd-cad7-492b-ae90-0ef1b95243b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:07.527580 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a707e1fd-cad7-492b-ae90-0ef1b95243b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:07.529329 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a707e1fd-cad7-492b-ae90-0ef1b95243b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:07.530522 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a707e1fd-cad7-492b-ae90-0ef1b95243b7 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1731 microversion: 2.20 time: 0.204732 Aug 01 07:44:07.531101 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 471/926] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:07 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:44:07.671529 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-5255451e-911a-4129-8808-d1b72142420d req-3eb2e401-793a-4e55-8cd3-eed83b33fa92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da493896-a5f9-4d76-95d6-52a82e82993e", "name": "network-vif-deleted", "tag": "8bf11c7c-0778-4b1e-85f5-92cc79efe14d"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:44:07.684133 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-5255451e-911a-4129-8808-d1b72142420d req-3eb2e401-793a-4e55-8cd3-eed83b33fa92 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:07.684958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-5255451e-911a-4129-8808-d1b72142420d req-3eb2e401-793a-4e55-8cd3-eed83b33fa92 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:07.698314 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-5255451e-911a-4129-8808-d1b72142420d req-3eb2e401-793a-4e55-8cd3-eed83b33fa92 service nova] Creating event network-vif-deleted:8bf11c7c-0778-4b1e-85f5-92cc79efe14d for instance da493896-a5f9-4d76-95d6-52a82e82993e on hv-cinder-73306 Aug 01 07:44:07.704007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-5255451e-911a-4129-8808-d1b72142420d req-3eb2e401-793a-4e55-8cd3-eed83b33fa92 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036402 Aug 01 07:44:07.709567 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 456/927] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:44:07.958578 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:07.965668 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:07.973374 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:07.974226 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:07.975852 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:07.976484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:08.020549 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:08.021004 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:08.021968 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lazy-loading 'fault' on Instance uuid da493896-a5f9-4d76-95d6-52a82e82993e {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:44:08.072911 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5958b9f3a2c4424db419e7b1c667ca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311edf4e3e534746bed2ff3a2888434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:08.088647 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5ccffe7c-52e5-40aa-87b5-ee02d26b70d1 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 200 len: 1325 microversion: 2.1 time: 0.135019 Aug 01 07:44:08.089231 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 472/928] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:07 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 1325 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:08.561640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8ee9c2c6-7255-40f3-ab9a-6c4ef7eac70a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:08.562783 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8ee9c2c6-7255-40f3-ab9a-6c4ef7eac70a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:08.572039 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8ee9c2c6-7255-40f3-ab9a-6c4ef7eac70a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:08.572632 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8ee9c2c6-7255-40f3-ab9a-6c4ef7eac70a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:08.573512 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8ee9c2c6-7255-40f3-ab9a-6c4ef7eac70a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:08.574168 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8ee9c2c6-7255-40f3-ab9a-6c4ef7eac70a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:08.719379 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8ee9c2c6-7255-40f3-ab9a-6c4ef7eac70a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:08.728950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8ee9c2c6-7255-40f3-ab9a-6c4ef7eac70a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:08.730714 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8ee9c2c6-7255-40f3-ab9a-6c4ef7eac70a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:08.731926 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8ee9c2c6-7255-40f3-ab9a-6c4ef7eac70a tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1718 microversion: 2.20 time: 0.176231 Aug 01 07:44:08.732491 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 457/929] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:08 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1718 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:44:09.111434 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-00ae533e-8df8-4866-ad7b-cff4b42d4d02 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:09.112155 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-00ae533e-8df8-4866-ad7b-cff4b42d4d02 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:09.118613 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-00ae533e-8df8-4866-ad7b-cff4b42d4d02 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:09.119090 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-00ae533e-8df8-4866-ad7b-cff4b42d4d02 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:09.119850 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-00ae533e-8df8-4866-ad7b-cff4b42d4d02 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:09.120286 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-00ae533e-8df8-4866-ad7b-cff4b42d4d02 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:09.133886 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-00ae533e-8df8-4866-ad7b-cff4b42d4d02 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] HTTP exception thrown: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-00ae533e-8df8-4866-ad7b-cff4b42d4d02 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Request method failure captured: Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e HTTP/1.1 Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54KsPH5Krst4IxwZx655o6wLhmKg6H_suMMRFGd7Ur8JDjDZGRh439JorXRaAyBwW7a6orRQ2vsVg-oK838JndAuppyx2P2RKFJRQ-cEeu2Y4TRX6Lu4xpMfClFIgD2T46UUERUIZE_DKKnpSRrl2XUKjBTwDyfYg9t-EdAvtBcZ7vY Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:44:09.135539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 5958b9f3a2c4424db419e7b1c667ca92 Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:09.137143 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': 'da493896-a5f9-4d76-95d6-52a82e82993e'} Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:09.138024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:09.139363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:09.140526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-00ae533e-8df8-4866-ad7b-cff4b42d4d02 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Returning 404 to user: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:09.140526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-00ae533e-8df8-4866-ad7b-cff4b42d4d02 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 404 len: 111 microversion: 2.1 time: 0.029435 Aug 01 07:44:09.140526 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 473/930] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:09 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:44:09.146606 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-21fe6110-83ce-44d6-9833-575a3caee67e tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '.version_select at 0x7fd01893b310>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:09.165786 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-21fe6110-83ce-44d6-9833-575a3caee67e tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-29442714" status: 202 len: 0 microversion: 2.1 time: 0.023848 Aug 01 07:44:09.166332 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 458/931] 10.222.0.40 () {58 vars in 1215 bytes} [Mon Aug 1 07:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-29442714 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:44:12.036859 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ba85ec57-e0df-4b42-a106-e14d4914bb74 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:12.037435 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ba85ec57-e0df-4b42-a106-e14d4914bb74 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:12.044250 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba85ec57-e0df-4b42-a106-e14d4914bb74 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:12.044707 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba85ec57-e0df-4b42-a106-e14d4914bb74 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:12.045495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba85ec57-e0df-4b42-a106-e14d4914bb74 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:12.045942 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ba85ec57-e0df-4b42-a106-e14d4914bb74 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:12.060820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-ba85ec57-e0df-4b42-a106-e14d4914bb74 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] HTTP exception thrown: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ba85ec57-e0df-4b42-a106-e14d4914bb74 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Request method failure captured: Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: DELETE /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e HTTP/1.1 Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54KsPH5Krst4IxwZx655o6wLhmKg6H_suMMRFGd7Ur8JDjDZGRh439JorXRaAyBwW7a6orRQ2vsVg-oK838JndAuppyx2P2RKFJRQ-cEeu2Y4TRX6Lu4xpMfClFIgD2T46UUERUIZE_DKKnpSRrl2XUKjBTwDyfYg9t-EdAvtBcZ7vY Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:44:12.062409 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 5958b9f3a2c4424db419e7b1c667ca92 Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:12.064096 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': 'da493896-a5f9-4d76-95d6-52a82e82993e'} Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:12.065116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:12.066368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:12.067690 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ba85ec57-e0df-4b42-a106-e14d4914bb74 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Returning 404 to user: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:12.067690 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ba85ec57-e0df-4b42-a106-e14d4914bb74 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "DELETE /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 404 len: 111 microversion: 2.1 time: 0.031603 Aug 01 07:44:12.067690 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 474/932] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:44:12 2022] DELETE /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:44:12.073650 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2a9d2240-ccf0-4501-8f63-9ca5b778174d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:12.074270 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2a9d2240-ccf0-4501-8f63-9ca5b778174d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: da493896-a5f9-4d76-95d6-52a82e82993e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:12.076352 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:12.083858 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2a9d2240-ccf0-4501-8f63-9ca5b778174d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:12.084319 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2a9d2240-ccf0-4501-8f63-9ca5b778174d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:12.085111 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2a9d2240-ccf0-4501-8f63-9ca5b778174d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:12.085554 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2a9d2240-ccf0-4501-8f63-9ca5b778174d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:12.104100 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-2a9d2240-ccf0-4501-8f63-9ca5b778174d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] HTTP exception thrown: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2a9d2240-ccf0-4501-8f63-9ca5b778174d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Request method failure captured: Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e HTTP/1.1 Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KsPH5Krst4IxwZx655o6wLhmKg6H_suMMRFGd7Ur8JDjDZGRh439JorXRaAyBwW7a6orRQ2vsVg-oK838JndAuppyx2P2RKFJRQ-cEeu2Y4TRX6Lu4xpMfClFIgD2T46UUERUIZE_DKKnpSRrl2XUKjBTwDyfYg9t-EdAvtBcZ7vY Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:44:12.105759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 5958b9f3a2c4424db419e7b1c667ca92 Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:12.107426 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'da493896-a5f9-4d76-95d6-52a82e82993e'} Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:12.108281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. Aug 01 07:44:12.109757 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:12.111080 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2a9d2240-ccf0-4501-8f63-9ca5b778174d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Returning 404 to user: Instance da493896-a5f9-4d76-95d6-52a82e82993e could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:12.111080 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2a9d2240-ccf0-4501-8f63-9ca5b778174d tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e" status: 404 len: 111 microversion: 2.1 time: 0.038101 Aug 01 07:44:12.111080 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 459/933] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:12 2022] GET /compute/v2.1/servers/da493896-a5f9-4d76-95d6-52a82e82993e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 07:44:13.246204 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-eff2c829-d7ac-42ba-bc6b-b9728cb2f935 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:13.246707 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-eff2c829-d7ac-42ba-bc6b-b9728cb2f935 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:13.253567 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-eff2c829-d7ac-42ba-bc6b-b9728cb2f935 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:13.254015 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-eff2c829-d7ac-42ba-bc6b-b9728cb2f935 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:13.254784 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-eff2c829-d7ac-42ba-bc6b-b9728cb2f935 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:13.255274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-eff2c829-d7ac-42ba-bc6b-b9728cb2f935 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:13.269247 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-eff2c829-d7ac-42ba-bc6b-b9728cb2f935 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] HTTP exception thrown: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-eff2c829-d7ac-42ba-bc6b-b9728cb2f935 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Request method failure captured: Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: DELETE /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 HTTP/1.1 Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54KsPH5Krst4IxwZx655o6wLhmKg6H_suMMRFGd7Ur8JDjDZGRh439JorXRaAyBwW7a6orRQ2vsVg-oK838JndAuppyx2P2RKFJRQ-cEeu2Y4TRX6Lu4xpMfClFIgD2T46UUERUIZE_DKKnpSRrl2XUKjBTwDyfYg9t-EdAvtBcZ7vY Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:44:13.270815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 5958b9f3a2c4424db419e7b1c667ca92 Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:44:13.272487 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '48863078-f7de-4370-af9c-4bdba932b5c3'} Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:13.273365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:44:13.274803 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:13.276786 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-eff2c829-d7ac-42ba-bc6b-b9728cb2f935 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Returning 404 to user: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:13.276786 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-eff2c829-d7ac-42ba-bc6b-b9728cb2f935 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "DELETE /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 404 len: 111 microversion: 2.1 time: 0.029950 Aug 01 07:44:13.276786 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 475/934] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:44:13 2022] DELETE /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:44:13.280698 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-08cd68b4-dab8-4206-836c-4c894993ca92 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:13.281306 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-08cd68b4-dab8-4206-836c-4c894993ca92 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] [instance: 48863078-f7de-4370-af9c-4bdba932b5c3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:13.289409 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08cd68b4-dab8-4206-836c-4c894993ca92 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:13.289867 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08cd68b4-dab8-4206-836c-4c894993ca92 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:13.290631 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08cd68b4-dab8-4206-836c-4c894993ca92 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:13.291129 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08cd68b4-dab8-4206-836c-4c894993ca92 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:13.305018 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-08cd68b4-dab8-4206-836c-4c894993ca92 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] HTTP exception thrown: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-08cd68b4-dab8-4206-836c-4c894993ca92 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Request method failure captured: Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 HTTP/1.1 Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54KsPH5Krst4IxwZx655o6wLhmKg6H_suMMRFGd7Ur8JDjDZGRh439JorXRaAyBwW7a6orRQ2vsVg-oK838JndAuppyx2P2RKFJRQ-cEeu2Y4TRX6Lu4xpMfClFIgD2T46UUERUIZE_DKKnpSRrl2XUKjBTwDyfYg9t-EdAvtBcZ7vY Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:44:13.306525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_311edf4e3e534746bed2ff3a2888434d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 311edf4e3e534746bed2ff3a2888434d Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606713402 Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 5958b9f3a2c4424db419e7b1c667ca92 Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeTestJSON-606713402-project Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:44:13.308206 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '48863078-f7de-4370-af9c-4bdba932b5c3'} Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:13.309239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. Aug 01 07:44:13.310646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:13.311955 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-08cd68b4-dab8-4206-836c-4c894993ca92 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] Returning 404 to user: Instance 48863078-f7de-4370-af9c-4bdba932b5c3 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:13.311955 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-08cd68b4-dab8-4206-836c-4c894993ca92 tempest-AttachVolumeTestJSON-606713402 tempest-AttachVolumeTestJSON-606713402-project] 10.222.0.40 "GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3" status: 404 len: 111 microversion: 2.1 time: 0.031116 Aug 01 07:44:13.311955 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 460/935] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:13 2022] GET /compute/v2.1/servers/48863078-f7de-4370-af9c-4bdba932b5c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:44:22.117102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-69b2bdca-9aab-4bd6-b340-33817910c0de tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: .version_select at 0x7fd018a3f550>, body: {"keypair": {"name": "tempest-keypair-648604514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+vZvq5xDBA7ashf+La5tXY07sTTAt/SVl4LhBjlK9eJ4v0BxA/O2edPwBCw8xkGGSFYxMxbfLklhJVQHmXK/fCwhyWL08XVqJqEV5PCsJeBo/Fgvobv03M4OyUE2zpmw=="}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:44:22.122926 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:22.136081 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-69b2bdca-9aab-4bd6-b340-33817910c0de tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for project 49e0013064fc495285dad557b0beef7d. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:44:22.140302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-69b2bdca-9aab-4bd6-b340-33817910c0de tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for user 1ba46a929ed54c51a33662367289eee5 and project 49e0013064fc495285dad557b0beef7d. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:44:22.165078 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-69b2bdca-9aab-4bd6-b340-33817910c0de tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182269 Aug 01 07:44:22.165885 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 476/936] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 1 07:44:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:44:23.627377 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-817257064", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d0500b7-ad41-4ce8-9297-aa02b3bcbfff"}], "security_groups": [{"name": "tempest-securitygroup--974109217"}], "key_name": "tempest-keypair-648604514", "user_data": "}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:44:23.638106 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=3 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:23.638872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:23.757259 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] validate_networks() for [('4d0500b7-ad41-4ce8-9297-aa02b3bcbfff', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:44:24.252223 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:44:24.252671 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:44:24.253294 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:44:24.253704 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:44:24.254794 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:44:24.264392 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:24.264844 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:24.265879 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:24.266318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:24.284962 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for project 49e0013064fc495285dad557b0beef7d. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:44:24.289031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for user 1ba46a929ed54c51a33662367289eee5 and project 49e0013064fc495285dad557b0beef7d. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:44:24.300803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:44:24.302901 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:44:24.360136 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9b8ce341-4390-41b3-bb10-a66b154e8963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.737804 Aug 01 07:44:24.360952 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 461/937] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:44:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:44:24.372693 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:24.379512 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-901a3117-e6c9-42d9-9fb6-696b1a541c37 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:24.380559 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-901a3117-e6c9-42d9-9fb6-696b1a541c37 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:24.468546 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-901a3117-e6c9-42d9-9fb6-696b1a541c37 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:24.477352 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-901a3117-e6c9-42d9-9fb6-696b1a541c37 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1240 microversion: 2.1 time: 0.106516 Aug 01 07:44:24.478033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 477/938] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:24 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:25.505366 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-eef4b163-2adc-4c61-a40f-9e754f63f6f7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:25.506779 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-eef4b163-2adc-4c61-a40f-9e754f63f6f7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:25.515687 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eef4b163-2adc-4c61-a40f-9e754f63f6f7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:25.516149 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eef4b163-2adc-4c61-a40f-9e754f63f6f7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:25.516940 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eef4b163-2adc-4c61-a40f-9e754f63f6f7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:25.517447 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eef4b163-2adc-4c61-a40f-9e754f63f6f7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:25.604768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-eef4b163-2adc-4c61-a40f-9e754f63f6f7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:25.614706 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-eef4b163-2adc-4c61-a40f-9e754f63f6f7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1300 microversion: 2.1 time: 0.114807 Aug 01 07:44:25.615708 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 462/939] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:25 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:26.636686 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3ed1e8ec-6fd6-47b9-8e26-aacc14c849ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:26.637295 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3ed1e8ec-6fd6-47b9-8e26-aacc14c849ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:26.643883 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3ed1e8ec-6fd6-47b9-8e26-aacc14c849ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:26.644342 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3ed1e8ec-6fd6-47b9-8e26-aacc14c849ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:26.645169 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3ed1e8ec-6fd6-47b9-8e26-aacc14c849ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:26.645612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3ed1e8ec-6fd6-47b9-8e26-aacc14c849ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:26.788214 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3ed1e8ec-6fd6-47b9-8e26-aacc14c849ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:26.795712 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3ed1e8ec-6fd6-47b9-8e26-aacc14c849ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1365 microversion: 2.1 time: 0.162891 Aug 01 07:44:26.796297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 478/940] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:26 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:26.905561 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-4fcc6b11-dd19-46ee-ada0-a18375bdea97 req-b59672f1-222b-45f4-85e6-775003217576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7638196-f31a-47de-8500-475937e17054", "tag": "f1cb5bc6-2ff9-46dd-a83e-c1077f7618f6"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:44:26.918598 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-4fcc6b11-dd19-46ee-ada0-a18375bdea97 req-b59672f1-222b-45f4-85e6-775003217576 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:26.919054 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-4fcc6b11-dd19-46ee-ada0-a18375bdea97 req-b59672f1-222b-45f4-85e6-775003217576 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:26.931474 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-4fcc6b11-dd19-46ee-ada0-a18375bdea97 req-b59672f1-222b-45f4-85e6-775003217576 service nova] Creating event network-changed:f1cb5bc6-2ff9-46dd-a83e-c1077f7618f6 for instance d7638196-f31a-47de-8500-475937e17054 on hv-cinder-73306 Aug 01 07:44:26.936514 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-4fcc6b11-dd19-46ee-ada0-a18375bdea97 req-b59672f1-222b-45f4-85e6-775003217576 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035305 Aug 01 07:44:26.937099 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 463/941] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:44:27.816582 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9157be2c-914e-40e9-873b-0f19a2e6419c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:27.817187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9157be2c-914e-40e9-873b-0f19a2e6419c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:27.823656 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9157be2c-914e-40e9-873b-0f19a2e6419c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:27.824102 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9157be2c-914e-40e9-873b-0f19a2e6419c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:27.824877 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9157be2c-914e-40e9-873b-0f19a2e6419c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:27.825294 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9157be2c-914e-40e9-873b-0f19a2e6419c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:27.956708 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9157be2c-914e-40e9-873b-0f19a2e6419c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:27.964609 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9157be2c-914e-40e9-873b-0f19a2e6419c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1365 microversion: 2.1 time: 0.151952 Aug 01 07:44:27.965488 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 479/942] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:27 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:28.987394 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-46271824-d37e-4b81-bd6f-0f984991be93 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:28.988103 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-46271824-d37e-4b81-bd6f-0f984991be93 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:28.994412 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-46271824-d37e-4b81-bd6f-0f984991be93 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:28.994870 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-46271824-d37e-4b81-bd6f-0f984991be93 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:28.995667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-46271824-d37e-4b81-bd6f-0f984991be93 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:28.996113 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-46271824-d37e-4b81-bd6f-0f984991be93 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:29.448467 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-46271824-d37e-4b81-bd6f-0f984991be93 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:29.456462 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-46271824-d37e-4b81-bd6f-0f984991be93 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1365 microversion: 2.1 time: 0.474373 Aug 01 07:44:29.457035 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 464/943] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:28 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1365 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:29.658711 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7b953682-6b5d-438a-a7c8-27fc85ec32a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:29.659925 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7b953682-6b5d-438a-a7c8-27fc85ec32a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:29.660653 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-82be0272-77a3-4d02-b999-8914223ddb7a req-489388b6-f628-4b72-aacd-2845d1c28a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b28df3b-0e7f-425f-9e11-c2e34a32f31e", "tag": "8385f662-a544-477f-910d-b785d83e699e"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:44:29.666694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b953682-6b5d-438a-a7c8-27fc85ec32a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:29.667179 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b953682-6b5d-438a-a7c8-27fc85ec32a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:29.668179 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b953682-6b5d-438a-a7c8-27fc85ec32a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:29.668811 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b953682-6b5d-438a-a7c8-27fc85ec32a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:29.670183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-82be0272-77a3-4d02-b999-8914223ddb7a req-489388b6-f628-4b72-aacd-2845d1c28a5c service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:29.670642 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-82be0272-77a3-4d02-b999-8914223ddb7a req-489388b6-f628-4b72-aacd-2845d1c28a5c service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:29.683109 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-82be0272-77a3-4d02-b999-8914223ddb7a req-489388b6-f628-4b72-aacd-2845d1c28a5c service nova] Creating event network-changed:8385f662-a544-477f-910d-b785d83e699e for instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e on hv-cinder-73306 Aug 01 07:44:29.688181 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-82be0272-77a3-4d02-b999-8914223ddb7a req-489388b6-f628-4b72-aacd-2845d1c28a5c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031450 Aug 01 07:44:29.689635 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 465/944] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:44:29.699717 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7b953682-6b5d-438a-a7c8-27fc85ec32a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:44:29.795520 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7b953682-6b5d-438a-a7c8-27fc85ec32a7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 204 len: 0 microversion: 2.1 time: 0.139546 Aug 01 07:44:29.796307 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 480/945] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:44:29 2022] DELETE /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:44:29.806583 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cd692855-e9f7-4e1f-822a-3e5e01b72624 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:29.807463 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-cd692855-e9f7-4e1f-822a-3e5e01b72624 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:29.814816 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cd692855-e9f7-4e1f-822a-3e5e01b72624 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:29.815706 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cd692855-e9f7-4e1f-822a-3e5e01b72624 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:29.816569 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cd692855-e9f7-4e1f-822a-3e5e01b72624 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:29.817084 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-cd692855-e9f7-4e1f-822a-3e5e01b72624 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:29.992654 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-cd692855-e9f7-4e1f-822a-3e5e01b72624 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:30.000341 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-cd692855-e9f7-4e1f-822a-3e5e01b72624 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.197980 Aug 01 07:44:30.000900 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 466/946] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:29 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:30.477603 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-74edfd5d-bfa3-4a93-bb6c-5f0c76a217ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:30.478406 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-74edfd5d-bfa3-4a93-bb6c-5f0c76a217ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:30.484605 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-74edfd5d-bfa3-4a93-bb6c-5f0c76a217ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:30.485060 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-74edfd5d-bfa3-4a93-bb6c-5f0c76a217ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:30.485869 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-74edfd5d-bfa3-4a93-bb6c-5f0c76a217ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:30.486320 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-74edfd5d-bfa3-4a93-bb6c-5f0c76a217ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:30.635348 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-74edfd5d-bfa3-4a93-bb6c-5f0c76a217ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:30.644425 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-74edfd5d-bfa3-4a93-bb6c-5f0c76a217ce tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1365 microversion: 2.1 time: 0.170957 Aug 01 07:44:30.651273 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 481/947] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:30 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:31.022484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-baeaa956-c496-45ed-af10-d5d590083576 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:31.023119 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-baeaa956-c496-45ed-af10-d5d590083576 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:31.029520 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-baeaa956-c496-45ed-af10-d5d590083576 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:31.029964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-baeaa956-c496-45ed-af10-d5d590083576 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:31.030730 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-baeaa956-c496-45ed-af10-d5d590083576 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:31.031191 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-baeaa956-c496-45ed-af10-d5d590083576 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:31.197142 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-baeaa956-c496-45ed-af10-d5d590083576 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:31.205272 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-baeaa956-c496-45ed-af10-d5d590083576 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1568 microversion: 2.1 time: 0.185904 Aug 01 07:44:31.205835 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 467/948] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:31 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:31.664518 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a616e477-e72a-4ea7-ab99-21b52d12bd3d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:31.665111 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a616e477-e72a-4ea7-ab99-21b52d12bd3d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:31.671525 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a616e477-e72a-4ea7-ab99-21b52d12bd3d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:31.671976 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a616e477-e72a-4ea7-ab99-21b52d12bd3d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:31.672746 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a616e477-e72a-4ea7-ab99-21b52d12bd3d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:31.673712 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a616e477-e72a-4ea7-ab99-21b52d12bd3d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:31.808768 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a616e477-e72a-4ea7-ab99-21b52d12bd3d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:31.817533 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a616e477-e72a-4ea7-ab99-21b52d12bd3d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1365 microversion: 2.1 time: 0.156824 Aug 01 07:44:31.818114 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 482/949] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:31 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:32.027004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-0ba81263-3bdd-4c75-8466-e2c9eae920ab req-82d0b10c-d500-4e49-bfdf-bd49a84c44ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b28df3b-0e7f-425f-9e11-c2e34a32f31e", "name": "network-vif-deleted", "tag": "8385f662-a544-477f-910d-b785d83e699e"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:44:32.037863 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-0ba81263-3bdd-4c75-8466-e2c9eae920ab req-82d0b10c-d500-4e49-bfdf-bd49a84c44ce service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:32.038233 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-0ba81263-3bdd-4c75-8466-e2c9eae920ab req-82d0b10c-d500-4e49-bfdf-bd49a84c44ce service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:32.049817 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-0ba81263-3bdd-4c75-8466-e2c9eae920ab req-82d0b10c-d500-4e49-bfdf-bd49a84c44ce service nova] Creating event network-vif-deleted:8385f662-a544-477f-910d-b785d83e699e for instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e on hv-cinder-73306 Aug 01 07:44:32.054787 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-0ba81263-3bdd-4c75-8466-e2c9eae920ab req-82d0b10c-d500-4e49-bfdf-bd49a84c44ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031417 Aug 01 07:44:32.055415 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 468/950] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:44:32.187824 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-71893d09-11e2-4351-a712-c348cd97cdc2 req-6a58cf56-903c-4e5e-90b0-82c7978894fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7638196-f31a-47de-8500-475937e17054", "name": "network-vif-plugged", "status": "completed", "tag": "f1cb5bc6-2ff9-46dd-a83e-c1077f7618f6"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:44:32.198256 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-71893d09-11e2-4351-a712-c348cd97cdc2 req-6a58cf56-903c-4e5e-90b0-82c7978894fe service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:32.198741 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-71893d09-11e2-4351-a712-c348cd97cdc2 req-6a58cf56-903c-4e5e-90b0-82c7978894fe service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:32.213492 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-71893d09-11e2-4351-a712-c348cd97cdc2 req-6a58cf56-903c-4e5e-90b0-82c7978894fe service nova] Creating event network-vif-plugged:f1cb5bc6-2ff9-46dd-a83e-c1077f7618f6 for instance d7638196-f31a-47de-8500-475937e17054 on hv-cinder-73306 Aug 01 07:44:32.218308 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-71893d09-11e2-4351-a712-c348cd97cdc2 req-6a58cf56-903c-4e5e-90b0-82c7978894fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 Aug 01 07:44:32.218888 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 483/951] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:44:32.226235 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-81a68bcc-8f65-46fe-afba-fb235c13c0f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:32.226919 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-81a68bcc-8f65-46fe-afba-fb235c13c0f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:32.233251 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-81a68bcc-8f65-46fe-afba-fb235c13c0f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:32.233706 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-81a68bcc-8f65-46fe-afba-fb235c13c0f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:32.234519 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-81a68bcc-8f65-46fe-afba-fb235c13c0f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:32.235013 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-81a68bcc-8f65-46fe-afba-fb235c13c0f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:32.326867 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-81a68bcc-8f65-46fe-afba-fb235c13c0f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd714badcdf8e4461ae1f7ebe4f0c82d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07c6f16ad7747c5a42b4d0351a44545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:32.341855 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-81a68bcc-8f65-46fe-afba-fb235c13c0f7 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 200 len: 1219 microversion: 2.1 time: 0.119573 Aug 01 07:44:32.342662 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 469/952] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:32 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:32.838701 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-69842937-16a9-4801-a3ea-b1f53becda82 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:32.839359 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-69842937-16a9-4801-a3ea-b1f53becda82 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:32.846163 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-69842937-16a9-4801-a3ea-b1f53becda82 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:32.846610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-69842937-16a9-4801-a3ea-b1f53becda82 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:32.847387 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-69842937-16a9-4801-a3ea-b1f53becda82 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:32.847818 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-69842937-16a9-4801-a3ea-b1f53becda82 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:32.981124 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-69842937-16a9-4801-a3ea-b1f53becda82 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:32.989825 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-69842937-16a9-4801-a3ea-b1f53becda82 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1365 microversion: 2.1 time: 0.155785 Aug 01 07:44:32.990391 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 484/953] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:32 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:33.362914 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-aa76ffa5-e801-4fdb-b41b-8499924de2e8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:33.363620 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-aa76ffa5-e801-4fdb-b41b-8499924de2e8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] [instance: 0b28df3b-0e7f-425f-9e11-c2e34a32f31e] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:33.370442 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aa76ffa5-e801-4fdb-b41b-8499924de2e8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:33.370904 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aa76ffa5-e801-4fdb-b41b-8499924de2e8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:33.371698 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aa76ffa5-e801-4fdb-b41b-8499924de2e8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:33.373068 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-aa76ffa5-e801-4fdb-b41b-8499924de2e8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:33.387121 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-aa76ffa5-e801-4fdb-b41b-8499924de2e8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] HTTP exception thrown: Instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e could not be found. Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-aa76ffa5-e801-4fdb-b41b-8499924de2e8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Request method failure captured: Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e HTTP/1.1 Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54L-Kna51lDNArurN1UNI2oY_jofsSt3tqreF_ufn9PQEDnKS32hP36xQ9He70dRgIFcefiPPzaRnsFDuwQ_iJoJHRzCf9TB0oABJ4QCo3BDUHL0rCt7ci5YU8g_ORiE1K3J2v_MRIpNOzO4ksGjKAfWjW3O0Xe8a5T5QH_wcLJt2I8 Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: f07c6f16ad7747c5a42b4d0351a44545 Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-TestShelveInstance-1643789781 Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:44:33.388734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f07c6f16ad7747c5a42b4d0351a44545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f07c6f16ad7747c5a42b4d0351a44545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f07c6f16ad7747c5a42b4d0351a44545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f07c6f16ad7747c5a42b4d0351a44545"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-TestShelveInstance-1643789781 Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: f07c6f16ad7747c5a42b4d0351a44545 Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-TestShelveInstance-1643789781 Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-TestShelveInstance-1643789781-project Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: d714badcdf8e4461ae1f7ebe4f0c82d4 Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-TestShelveInstance-1643789781-project Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e could not be found. Aug 01 07:44:33.390388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '0b28df3b-0e7f-425f-9e11-c2e34a32f31e'} Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e could not be found. Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:33.391577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e could not be found. Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e could not be found. Aug 01 07:44:33.393724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:33.395241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-aa76ffa5-e801-4fdb-b41b-8499924de2e8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Returning 404 to user: Instance 0b28df3b-0e7f-425f-9e11-c2e34a32f31e could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:33.395241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-aa76ffa5-e801-4fdb-b41b-8499924de2e8 tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e" status: 404 len: 111 microversion: 2.1 time: 0.031608 Aug 01 07:44:33.395241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 470/954] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:33 2022] GET /compute/v2.1/servers/0b28df3b-0e7f-425f-9e11-c2e34a32f31e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:44:33.546699 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-642e5cf7-4de0-49d3-b017-78bd15c1ab2d tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] Calling method '.version_select at 0x7fd018bc85e0>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:33.572447 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-642e5cf7-4de0-49d3-b017-78bd15c1ab2d tempest-TestShelveInstance-1643789781 tempest-TestShelveInstance-1643789781-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1321786183" status: 202 len: 0 microversion: 2.1 time: 0.029426 Aug 01 07:44:33.573132 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 485/955] 10.222.0.40 () {58 vars in 1254 bytes} [Mon Aug 1 07:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1321786183 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:44:34.011701 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1bc0964e-2639-4faf-9314-07e672f2d405 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:34.012313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1bc0964e-2639-4faf-9314-07e672f2d405 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:34.018313 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1bc0964e-2639-4faf-9314-07e672f2d405 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:34.018773 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1bc0964e-2639-4faf-9314-07e672f2d405 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:34.019572 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1bc0964e-2639-4faf-9314-07e672f2d405 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:34.020015 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1bc0964e-2639-4faf-9314-07e672f2d405 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:34.234895 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1bc0964e-2639-4faf-9314-07e672f2d405 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:34.243285 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1bc0964e-2639-4faf-9314-07e672f2d405 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1365 microversion: 2.1 time: 0.235348 Aug 01 07:44:34.244038 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 471/956] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:34 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:35.262133 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=6 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:35.267412 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8510ace1-4f4e-42a5-8de4-759226d80c53 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:35.268315 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8510ace1-4f4e-42a5-8de4-759226d80c53 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:35.274804 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8510ace1-4f4e-42a5-8de4-759226d80c53 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:35.275297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8510ace1-4f4e-42a5-8de4-759226d80c53 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:35.276147 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8510ace1-4f4e-42a5-8de4-759226d80c53 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:35.276595 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8510ace1-4f4e-42a5-8de4-759226d80c53 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:35.436991 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8510ace1-4f4e-42a5-8de4-759226d80c53 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:35.445628 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8510ace1-4f4e-42a5-8de4-759226d80c53 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1555 microversion: 2.1 time: 0.184731 Aug 01 07:44:35.453152 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 486/957] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:44:35 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:35.467249 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-91a0bd13-0a23-4060-af79-078e1db3b2c6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:35.468472 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-91a0bd13-0a23-4060-af79-078e1db3b2c6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:35.472576 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:35.473600 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=6 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:35.478385 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91a0bd13-0a23-4060-af79-078e1db3b2c6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:35.478980 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91a0bd13-0a23-4060-af79-078e1db3b2c6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:35.479862 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91a0bd13-0a23-4060-af79-078e1db3b2c6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:35.480364 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-91a0bd13-0a23-4060-af79-078e1db3b2c6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:35.654048 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-91a0bd13-0a23-4060-af79-078e1db3b2c6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191280 Aug 01 07:44:35.654954 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 472/958] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 1 07:44:35 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:44:37.183191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-a2fa178f-79a8-439a-8915-4dbdebdcec2c req-97de18a9-c692-4f2f-925d-f96578ad6931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7638196-f31a-47de-8500-475937e17054", "tag": "f1cb5bc6-2ff9-46dd-a83e-c1077f7618f6"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:44:37.195546 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-a2fa178f-79a8-439a-8915-4dbdebdcec2c req-97de18a9-c692-4f2f-925d-f96578ad6931 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:37.196141 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-a2fa178f-79a8-439a-8915-4dbdebdcec2c req-97de18a9-c692-4f2f-925d-f96578ad6931 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:37.208308 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-a2fa178f-79a8-439a-8915-4dbdebdcec2c req-97de18a9-c692-4f2f-925d-f96578ad6931 service nova] Creating event network-changed:f1cb5bc6-2ff9-46dd-a83e-c1077f7618f6 for instance d7638196-f31a-47de-8500-475937e17054 on hv-cinder-73306 Aug 01 07:44:37.213413 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-a2fa178f-79a8-439a-8915-4dbdebdcec2c req-97de18a9-c692-4f2f-925d-f96578ad6931 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034593 Aug 01 07:44:37.214324 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 487/959] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:44:47.062491 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:47.063390 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=50 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:47.068100 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-96837e82-24df-468d-9b3f-f5a7a896ec03 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:47.070224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-96837e82-24df-468d-9b3f-f5a7a896ec03 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:47.077825 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-96837e82-24df-468d-9b3f-f5a7a896ec03 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:47.078285 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-96837e82-24df-468d-9b3f-f5a7a896ec03 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:47.079058 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-96837e82-24df-468d-9b3f-f5a7a896ec03 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:47.079554 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-96837e82-24df-468d-9b3f-f5a7a896ec03 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:47.108358 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-96837e82-24df-468d-9b3f-f5a7a896ec03 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047093 Aug 01 07:44:47.108894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 473/960] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 1 07:44:47 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:44:47.172088 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-24f96a16-bea2-4957-a1b3-2be1a7ebb757 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:47.172664 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-24f96a16-bea2-4957-a1b3-2be1a7ebb757 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:47.179495 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-24f96a16-bea2-4957-a1b3-2be1a7ebb757 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:47.179939 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-24f96a16-bea2-4957-a1b3-2be1a7ebb757 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:47.180693 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-24f96a16-bea2-4957-a1b3-2be1a7ebb757 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:47.181123 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-24f96a16-bea2-4957-a1b3-2be1a7ebb757 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:47.204916 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-24f96a16-bea2-4957-a1b3-2be1a7ebb757 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:44:47.280430 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-24f96a16-bea2-4957-a1b3-2be1a7ebb757 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 204 len: 0 microversion: 2.20 time: 0.113029 Aug 01 07:44:47.280970 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 488/961] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Aug 1 07:44:47 2022] DELETE /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 07:44:47.289792 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1b987ba6-3c72-4088-bc7f-d1491caf1b90 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:47.290390 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1b987ba6-3c72-4088-bc7f-d1491caf1b90 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:47.296913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b987ba6-3c72-4088-bc7f-d1491caf1b90 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:47.297360 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b987ba6-3c72-4088-bc7f-d1491caf1b90 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:47.298751 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b987ba6-3c72-4088-bc7f-d1491caf1b90 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:47.299223 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1b987ba6-3c72-4088-bc7f-d1491caf1b90 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:47.429409 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1b987ba6-3c72-4088-bc7f-d1491caf1b90 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:47.437487 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1b987ba6-3c72-4088-bc7f-d1491caf1b90 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:47.439046 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1b987ba6-3c72-4088-bc7f-d1491caf1b90 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:47.440479 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1b987ba6-3c72-4088-bc7f-d1491caf1b90 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.154539 Aug 01 07:44:47.441030 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 474/962] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:47 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:44:48.465580 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-bec9e44d-cf8d-438e-8ef0-ce22b951df64 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:48.466278 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-bec9e44d-cf8d-438e-8ef0-ce22b951df64 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:48.472826 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bec9e44d-cf8d-438e-8ef0-ce22b951df64 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:48.473281 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bec9e44d-cf8d-438e-8ef0-ce22b951df64 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:48.474043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bec9e44d-cf8d-438e-8ef0-ce22b951df64 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:48.474479 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-bec9e44d-cf8d-438e-8ef0-ce22b951df64 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:48.614205 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bec9e44d-cf8d-438e-8ef0-ce22b951df64 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:48.622341 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bec9e44d-cf8d-438e-8ef0-ce22b951df64 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:48.623914 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-bec9e44d-cf8d-438e-8ef0-ce22b951df64 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:48.625353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-bec9e44d-cf8d-438e-8ef0-ce22b951df64 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1724 microversion: 2.20 time: 0.164150 Aug 01 07:44:48.625910 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 489/963] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:48 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:44:49.539189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-3e345142-73cd-4558-a8de-b4b74980b068 req-aaa2fb9b-3372-4944-86c7-96554974699e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f30f324-1dcf-44b9-b81d-ef96811b0a87", "name": "network-vif-deleted", "tag": "23ceaa56-07cb-42cc-83de-2bfdae7aac98"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:44:49.550554 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-3e345142-73cd-4558-a8de-b4b74980b068 req-aaa2fb9b-3372-4944-86c7-96554974699e service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:49.551009 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-3e345142-73cd-4558-a8de-b4b74980b068 req-aaa2fb9b-3372-4944-86c7-96554974699e service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:49.563893 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-3e345142-73cd-4558-a8de-b4b74980b068 req-aaa2fb9b-3372-4944-86c7-96554974699e service nova] Creating event network-vif-deleted:23ceaa56-07cb-42cc-83de-2bfdae7aac98 for instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 on hv-cinder-73306 Aug 01 07:44:49.569457 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-3e345142-73cd-4558-a8de-b4b74980b068 req-aaa2fb9b-3372-4944-86c7-96554974699e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033905 Aug 01 07:44:49.570230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 475/964] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:44:49.650769 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:49.651432 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:49.667590 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:49.668156 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:49.669038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:49.669682 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:49.706280 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:49.706725 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:49.707208 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.objects.instance [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lazy-loading 'fault' on Instance uuid 0f30f324-1dcf-44b9-b81d-ef96811b0a87 {{(pid=124279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:44:49.756243 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:49.770092 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:49.772063 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e02f414ef2a4990bd1492a63d074319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2b83a4dad243e79144db87357d1897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:44:49.773530 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-2debeff6-ccc6-4088-bbba-1c7f46c5554d tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 200 len: 1372 microversion: 2.20 time: 0.127574 Aug 01 07:44:49.774603 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 490/965] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:49 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 1372 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:44:50.798669 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e7417644-b664-460e-93f7-f022e2fd5341 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:50.799602 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e7417644-b664-460e-93f7-f022e2fd5341 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:50.807007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e7417644-b664-460e-93f7-f022e2fd5341 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:50.807491 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e7417644-b664-460e-93f7-f022e2fd5341 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:50.808287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e7417644-b664-460e-93f7-f022e2fd5341 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:50.808729 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e7417644-b664-460e-93f7-f022e2fd5341 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:50.824255 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-e7417644-b664-460e-93f7-f022e2fd5341 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] HTTP exception thrown: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e7417644-b664-460e-93f7-f022e2fd5341 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Request method failure captured: Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 HTTP/1.1 Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54K23XEuD4dhD-3BUUnDIlZvhK2AlVEUHMzuBt1F2oosUBsTXdfAJ0ki1HmOCwZG11eZTEoiD7KAeLf6MmZZ8hcf6j_DPCvAcWKOjhp1PPO5fzBDbI3fnZBJ_pfSA2RJGmd_dl0uTGDESFoVLsvXMOwZYeqHiuOg9cSjH31siSo7cSQ Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:44:50.825922 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a2b83a4dad243e79144db87357d1897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1e02f414ef2a4990bd1492a63d074319 Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:50.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '0f30f324-1dcf-44b9-b81d-ef96811b0a87'} Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:50.828367 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:50.829857 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:50.831284 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e7417644-b664-460e-93f7-f022e2fd5341 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Returning 404 to user: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:50.831284 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e7417644-b664-460e-93f7-f022e2fd5341 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 404 len: 111 microversion: 2.20 time: 0.034278 Aug 01 07:44:50.831284 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 476/966] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:50 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 07:44:50.836609 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-92aa51d9-1514-4f0f-ab37-dbabcb5076ac tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '.version_select at 0x7fd018b0b790>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:50.855882 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-92aa51d9-1514-4f0f-ab37-dbabcb5076ac tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049746085" status: 204 len: 0 microversion: 2.20 time: 0.023078 Aug 01 07:44:50.856475 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 491/967] 10.222.0.40 () {60 vars in 1262 bytes} [Mon Aug 1 07:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049746085 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 07:44:52.603560 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d2e2d867-94d0-4d75-a4aa-3fef1364f0b9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:52.604047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d2e2d867-94d0-4d75-a4aa-3fef1364f0b9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:52.610302 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d2e2d867-94d0-4d75-a4aa-3fef1364f0b9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:52.610750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d2e2d867-94d0-4d75-a4aa-3fef1364f0b9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:52.612375 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d2e2d867-94d0-4d75-a4aa-3fef1364f0b9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:52.612829 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d2e2d867-94d0-4d75-a4aa-3fef1364f0b9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:52.626280 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-d2e2d867-94d0-4d75-a4aa-3fef1364f0b9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] HTTP exception thrown: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d2e2d867-94d0-4d75-a4aa-3fef1364f0b9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Request method failure captured: Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 HTTP/1.1 Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54K23XEuD4dhD-3BUUnDIlZvhK2AlVEUHMzuBt1F2oosUBsTXdfAJ0ki1HmOCwZG11eZTEoiD7KAeLf6MmZZ8hcf6j_DPCvAcWKOjhp1PPO5fzBDbI3fnZBJ_pfSA2RJGmd_dl0uTGDESFoVLsvXMOwZYeqHiuOg9cSjH31siSo7cSQ Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:44:52.628435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a2b83a4dad243e79144db87357d1897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1e02f414ef2a4990bd1492a63d074319 Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:52.630096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '0f30f324-1dcf-44b9-b81d-ef96811b0a87'} Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:52.631215 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:52.632699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:52.634405 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d2e2d867-94d0-4d75-a4aa-3fef1364f0b9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Returning 404 to user: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:52.634405 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d2e2d867-94d0-4d75-a4aa-3fef1364f0b9 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 404 len: 111 microversion: 2.20 time: 0.030138 Aug 01 07:44:52.634405 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 477/968] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Aug 1 07:44:52 2022] DELETE /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 07:44:52.638506 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-751657a1-7995-49a0-b577-682ea033c258 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:52.639139 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-751657a1-7995-49a0-b577-682ea033c258 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 0f30f324-1dcf-44b9-b81d-ef96811b0a87] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:52.641036 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:44:52.650201 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-751657a1-7995-49a0-b577-682ea033c258 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:52.650649 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-751657a1-7995-49a0-b577-682ea033c258 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:52.651439 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-751657a1-7995-49a0-b577-682ea033c258 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:52.651876 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-751657a1-7995-49a0-b577-682ea033c258 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:52.666297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-751657a1-7995-49a0-b577-682ea033c258 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] HTTP exception thrown: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-751657a1-7995-49a0-b577-682ea033c258 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Request method failure captured: Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 HTTP/1.1 Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54K23XEuD4dhD-3BUUnDIlZvhK2AlVEUHMzuBt1F2oosUBsTXdfAJ0ki1HmOCwZG11eZTEoiD7KAeLf6MmZZ8hcf6j_DPCvAcWKOjhp1PPO5fzBDbI3fnZBJ_pfSA2RJGmd_dl0uTGDESFoVLsvXMOwZYeqHiuOg9cSjH31siSo7cSQ Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:44:52.667993 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a2b83a4dad243e79144db87357d1897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 1e02f414ef2a4990bd1492a63d074319 Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:52.669640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '0f30f324-1dcf-44b9-b81d-ef96811b0a87'} Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:52.670896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. Aug 01 07:44:52.672636 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:52.674637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-751657a1-7995-49a0-b577-682ea033c258 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Returning 404 to user: Instance 0f30f324-1dcf-44b9-b81d-ef96811b0a87 could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:52.674637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-751657a1-7995-49a0-b577-682ea033c258 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87" status: 404 len: 111 microversion: 2.20 time: 0.035187 Aug 01 07:44:52.674637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 492/969] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:52 2022] GET /compute/v2.1/servers/0f30f324-1dcf-44b9-b81d-ef96811b0a87 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 07:44:53.809434 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a3606dd8-62ef-495f-825d-0cabdff297ae tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:53.809935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a3606dd8-62ef-495f-825d-0cabdff297ae tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:53.816526 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a3606dd8-62ef-495f-825d-0cabdff297ae tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:53.816973 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a3606dd8-62ef-495f-825d-0cabdff297ae tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:53.817726 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a3606dd8-62ef-495f-825d-0cabdff297ae tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:53.818158 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a3606dd8-62ef-495f-825d-0cabdff297ae tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:53.831589 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-a3606dd8-62ef-495f-825d-0cabdff297ae tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] HTTP exception thrown: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a3606dd8-62ef-495f-825d-0cabdff297ae tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Request method failure captured: Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 HTTP/1.1 Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54K23XEuD4dhD-3BUUnDIlZvhK2AlVEUHMzuBt1F2oosUBsTXdfAJ0ki1HmOCwZG11eZTEoiD7KAeLf6MmZZ8hcf6j_DPCvAcWKOjhp1PPO5fzBDbI3fnZBJ_pfSA2RJGmd_dl0uTGDESFoVLsvXMOwZYeqHiuOg9cSjH31siSo7cSQ Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:44:53.833101 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a2b83a4dad243e79144db87357d1897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1e02f414ef2a4990bd1492a63d074319 Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:44:53.834722 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '8ff143cc-5a30-44be-a327-29eaacf61348'} Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:53.835756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:44:53.837224 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:44:53.839042 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a3606dd8-62ef-495f-825d-0cabdff297ae tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Returning 404 to user: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:53.839042 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a3606dd8-62ef-495f-825d-0cabdff297ae tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 404 len: 111 microversion: 2.20 time: 0.028912 Aug 01 07:44:53.839042 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 478/970] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Aug 1 07:44:53 2022] DELETE /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 07:44:53.843620 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-834fd142-c2b5-4c42-9402-3d0cd876f066 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:44:53.844230 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-834fd142-c2b5-4c42-9402-3d0cd876f066 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] [instance: 8ff143cc-5a30-44be-a327-29eaacf61348] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:44:53.851408 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-834fd142-c2b5-4c42-9402-3d0cd876f066 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:53.851866 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-834fd142-c2b5-4c42-9402-3d0cd876f066 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:53.852641 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-834fd142-c2b5-4c42-9402-3d0cd876f066 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:44:53.853084 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-834fd142-c2b5-4c42-9402-3d0cd876f066 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:44:53.867002 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-834fd142-c2b5-4c42-9402-3d0cd876f066 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] HTTP exception thrown: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-834fd142-c2b5-4c42-9402-3d0cd876f066 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Request method failure captured: Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 HTTP/1.1 Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54K23XEuD4dhD-3BUUnDIlZvhK2AlVEUHMzuBt1F2oosUBsTXdfAJ0ki1HmOCwZG11eZTEoiD7KAeLf6MmZZ8hcf6j_DPCvAcWKOjhp1PPO5fzBDbI3fnZBJ_pfSA2RJGmd_dl0uTGDESFoVLsvXMOwZYeqHiuOg9cSjH31siSo7cSQ Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:44:53.868570 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a2b83a4dad243e79144db87357d1897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a2b83a4dad243e79144db87357d1897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 4a2b83a4dad243e79144db87357d1897 Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1864968350 Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 1e02f414ef2a4990bd1492a63d074319 Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1864968350-project Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:44:53.870206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '8ff143cc-5a30-44be-a327-29eaacf61348'} Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:44:53.871287 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. Aug 01 07:44:53.872895 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:44:53.874368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-834fd142-c2b5-4c42-9402-3d0cd876f066 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] Returning 404 to user: Instance 8ff143cc-5a30-44be-a327-29eaacf61348 could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:44:53.874368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-834fd142-c2b5-4c42-9402-3d0cd876f066 tempest-AttachVolumeShelveTestJSON-1864968350 tempest-AttachVolumeShelveTestJSON-1864968350-project] 10.222.0.40 "GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348" status: 404 len: 111 microversion: 2.20 time: 0.031011 Aug 01 07:44:53.874368 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 493/971] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 1 07:44:53 2022] GET /compute/v2.1/servers/8ff143cc-5a30-44be-a327-29eaacf61348 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 07:45:13.408844 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-9363f588-bc2c-46d4-8313-9144f4300484 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:13.409380 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-9363f588-bc2c-46d4-8313-9144f4300484 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:13.411536 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=12 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:13.412223 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=20 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:13.417675 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9363f588-bc2c-46d4-8313-9144f4300484 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:13.418135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9363f588-bc2c-46d4-8313-9144f4300484 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:13.418919 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9363f588-bc2c-46d4-8313-9144f4300484 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:13.419388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-9363f588-bc2c-46d4-8313-9144f4300484 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:13.443422 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-9363f588-bc2c-46d4-8313-9144f4300484 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/ips" status: 200 len: 150 microversion: 2.1 time: 0.039047 Aug 01 07:45:13.444007 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 479/972] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 1 07:45:13 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:45:14.842319 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4c0da2ca-be17-417e-8ce3-cccb37ef0bdf tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5977ae6-4b09-4164-a8ec-89a84d6c8100"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:14.845579 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4c0da2ca-be17-417e-8ce3-cccb37ef0bdf tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:14.847836 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:14.848482 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:14.854556 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c0da2ca-be17-417e-8ce3-cccb37ef0bdf tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:14.855150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c0da2ca-be17-417e-8ce3-cccb37ef0bdf tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:14.856032 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c0da2ca-be17-417e-8ce3-cccb37ef0bdf tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:14.856598 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4c0da2ca-be17-417e-8ce3-cccb37ef0bdf tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:15.125384 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4c0da2ca-be17-417e-8ce3-cccb37ef0bdf tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286850 Aug 01 07:45:15.126841 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 494/973] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:45:14 2022] POST /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:45:23.732026 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cc7561c0-bb36-4ca1-8ac1-062bdcf7cc03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: .version_select at 0x7fd01d248790>, body: {"keypair": {"name": "tempest-keypair-935126645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr3lyXFmBwNIyBtEeQgjxgpR9viI8piGLuA+QHes5g2XZC1s25w0WND4g2Dm98jeF6GxiisQP1ojgOSMFQ0cpzvsaEw0824g2oqASU8eB4NE+Rp+QKRJ0PiuOLEIQcIBw=="}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:23.741542 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:23.742405 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=4 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:23.758230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-cc7561c0-bb36-4ca1-8ac1-062bdcf7cc03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for project 49e0013064fc495285dad557b0beef7d. Resources: {'key_pairs'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:45:23.764400 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-cc7561c0-bb36-4ca1-8ac1-062bdcf7cc03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for user 1ba46a929ed54c51a33662367289eee5 and project 49e0013064fc495285dad557b0beef7d. Resources: {'key_pairs'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:45:23.798155 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-cc7561c0-bb36-4ca1-8ac1-062bdcf7cc03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074613 Aug 01 07:45:23.798882 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 480/974] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 1 07:45:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:45:25.171147 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:25.171898 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:25.177756 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-442229664", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d0500b7-ad41-4ce8-9297-aa02b3bcbfff"}], "security_groups": [{"name": "tempest-securitygroup--328678225"}], "key_name": "tempest-keypair-935126645", "user_data": "}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:25.282093 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.network.neutron [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] validate_networks() for [('4d0500b7-ad41-4ce8-9297-aa02b3bcbfff', None, None, None, None, None)] {{(pid=124279) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:45:25.644909 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Flavor limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:45:25.645339 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Image limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:45:25.645817 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Flavor pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:45:25.646264 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Image pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:45:25.646677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:45:25.655453 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:25.655901 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:25.656699 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:25.657134 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:25.674731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for project 49e0013064fc495285dad557b0beef7d. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:45:25.678693 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for user 1ba46a929ed54c51a33662367289eee5 and project 49e0013064fc495285dad557b0beef7d. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:45:25.690461 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Going to run 1 instances... {{(pid=124279) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:45:25.692799 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:45:25.737937 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-46b7e291-9d45-4810-9299-444b0b0729b0 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.568190 Aug 01 07:45:25.738575 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 495/975] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:45:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:45:25.750217 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-303fa862-057f-416a-ab06-9c0b0735523d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:25.750969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-303fa862-057f-416a-ab06-9c0b0735523d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:25.810793 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-303fa862-057f-416a-ab06-9c0b0735523d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:25.818836 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-303fa862-057f-416a-ab06-9c0b0735523d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1240 microversion: 2.1 time: 0.073194 Aug 01 07:45:25.820260 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 481/976] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:25 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:26.840297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-d1aaeb38-d94a-48c9-a40b-3c15c63cef7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:26.841550 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-d1aaeb38-d94a-48c9-a40b-3c15c63cef7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:26.851400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d1aaeb38-d94a-48c9-a40b-3c15c63cef7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:26.852087 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d1aaeb38-d94a-48c9-a40b-3c15c63cef7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:26.855006 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d1aaeb38-d94a-48c9-a40b-3c15c63cef7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:26.855431 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-d1aaeb38-d94a-48c9-a40b-3c15c63cef7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:26.932792 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-d1aaeb38-d94a-48c9-a40b-3c15c63cef7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:26.941689 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-d1aaeb38-d94a-48c9-a40b-3c15c63cef7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1298 microversion: 2.1 time: 0.106308 Aug 01 07:45:26.942253 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 496/977] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:26 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:27.484897 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1741897534", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1723413518", "security_groups": [{"name": "tempest-secgroup-smoke-1404206193"}], "block_device_mapping_v2": [{"uuid": "cfa4f3c2-881b-4c99-954f-f0d06521291e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eaaa6e09-856c-4518-bc1e-d02d9efafed7"}]}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:27.673238 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] validate_networks() for [('eaaa6e09-856c-4518-bc1e-d02d9efafed7', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:45:27.964101 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-23c0e149-e816-4732-9013-bef4b5fc524b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:27.965748 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-23c0e149-e816-4732-9013-bef4b5fc524b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:27.974930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-23c0e149-e816-4732-9013-bef4b5fc524b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:27.975732 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-23c0e149-e816-4732-9013-bef4b5fc524b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:27.976741 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-23c0e149-e816-4732-9013-bef4b5fc524b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:27.977348 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-23c0e149-e816-4732-9013-bef4b5fc524b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:28.194546 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-23c0e149-e816-4732-9013-bef4b5fc524b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:28.202026 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-23c0e149-e816-4732-9013-bef4b5fc524b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1365 microversion: 2.1 time: 0.242689 Aug 01 07:45:28.202594 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 497/978] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:27 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:45:28.388054 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:45:28.388784 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:45:28.389401 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:45:28.390014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:45:28.390485 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:45:28.402288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:28.402288 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:28.403010 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:28.403477 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:28.423121 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Getting quotas for project 810069989cfb42799139be8ec2423288. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:45:28.427855 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Getting quotas for user 890be2e19b43473caa79b2dc889f8436 and project 810069989cfb42799139be8ec2423288. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:45:28.490112 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-c55ef1c6-ad70-42c6-b3cf-f7a2313472d8 req-b26a921e-1da0-4d6c-a0d0-2d71329d322b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "655fec6a-966b-4749-a00d-7c24e27bfaa1", "tag": "c2050d00-2a4d-480a-b950-fc9b6777da98"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:28.500699 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-c55ef1c6-ad70-42c6-b3cf-f7a2313472d8 req-b26a921e-1da0-4d6c-a0d0-2d71329d322b service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:28.506951 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-c55ef1c6-ad70-42c6-b3cf-f7a2313472d8 req-b26a921e-1da0-4d6c-a0d0-2d71329d322b service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:28.509606 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:45:28.513688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cfa4f3c2-881b-4c99-954f-f0d06521291e',volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:45:28.520596 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-c55ef1c6-ad70-42c6-b3cf-f7a2313472d8 req-b26a921e-1da0-4d6c-a0d0-2d71329d322b service nova] Creating event network-changed:c2050d00-2a4d-480a-b950-fc9b6777da98 for instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 on hv-cinder-73306 Aug 01 07:45:28.526297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-c55ef1c6-ad70-42c6-b3cf-f7a2313472d8 req-b26a921e-1da0-4d6c-a0d0-2d71329d322b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039525 Aug 01 07:45:28.527105 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 498/979] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:45:28.678511 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0789da93-ee96-428c-b35c-583e54f879c5 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.198479 Aug 01 07:45:28.679639 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 482/980] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:45:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:45:28.691954 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-76b613a3-46f8-4423-b7c8-142b160c05a4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:28.693075 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-76b613a3-46f8-4423-b7c8-142b160c05a4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:28.750284 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-76b613a3-46f8-4423-b7c8-142b160c05a4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:28.758996 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-76b613a3-46f8-4423-b7c8-142b160c05a4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1095 microversion: 2.1 time: 0.072169 Aug 01 07:45:28.760342 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 499/981] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:28 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:45:29.224080 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1c2847b7-f1c7-499f-85d2-a68799e9e3ba tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:29.224662 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1c2847b7-f1c7-499f-85d2-a68799e9e3ba tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:29.231825 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1c2847b7-f1c7-499f-85d2-a68799e9e3ba tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:29.232249 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1c2847b7-f1c7-499f-85d2-a68799e9e3ba tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:29.233020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1c2847b7-f1c7-499f-85d2-a68799e9e3ba tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:29.233455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1c2847b7-f1c7-499f-85d2-a68799e9e3ba tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:29.369094 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1c2847b7-f1c7-499f-85d2-a68799e9e3ba tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:29.377929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1c2847b7-f1c7-499f-85d2-a68799e9e3ba tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1365 microversion: 2.1 time: 0.158420 Aug 01 07:45:29.378716 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 483/982] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:29 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:29.789412 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-60e7e75a-9cc7-4df1-a922-74693b226855 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:29.790024 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-60e7e75a-9cc7-4df1-a922-74693b226855 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:29.797317 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-60e7e75a-9cc7-4df1-a922-74693b226855 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:29.797795 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-60e7e75a-9cc7-4df1-a922-74693b226855 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:29.798979 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-60e7e75a-9cc7-4df1-a922-74693b226855 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:29.799105 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-60e7e75a-9cc7-4df1-a922-74693b226855 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:29.864022 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-60e7e75a-9cc7-4df1-a922-74693b226855 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:29.872413 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-60e7e75a-9cc7-4df1-a922-74693b226855 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1145 microversion: 2.1 time: 0.087128 Aug 01 07:45:29.872999 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 500/983] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:29 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:30.404699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d501f1bb-df6c-49aa-b888-27ba6c90357d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:30.406183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d501f1bb-df6c-49aa-b888-27ba6c90357d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:30.416671 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d501f1bb-df6c-49aa-b888-27ba6c90357d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:30.417266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d501f1bb-df6c-49aa-b888-27ba6c90357d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:30.418170 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d501f1bb-df6c-49aa-b888-27ba6c90357d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:30.418721 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d501f1bb-df6c-49aa-b888-27ba6c90357d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:30.816713 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d501f1bb-df6c-49aa-b888-27ba6c90357d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:30.825780 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d501f1bb-df6c-49aa-b888-27ba6c90357d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1365 microversion: 2.1 time: 0.424809 Aug 01 07:45:30.838963 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 484/984] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:30 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1365 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:30.895613 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8d098d4b-31ad-44d5-9cd7-ea94a0a4e428 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:30.896442 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8d098d4b-31ad-44d5-9cd7-ea94a0a4e428 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:30.903506 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8d098d4b-31ad-44d5-9cd7-ea94a0a4e428 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:30.903917 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8d098d4b-31ad-44d5-9cd7-ea94a0a4e428 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:30.905518 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8d098d4b-31ad-44d5-9cd7-ea94a0a4e428 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:30.906066 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8d098d4b-31ad-44d5-9cd7-ea94a0a4e428 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:30.978067 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8d098d4b-31ad-44d5-9cd7-ea94a0a4e428 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:30.986536 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8d098d4b-31ad-44d5-9cd7-ea94a0a4e428 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1211 microversion: 2.1 time: 0.095814 Aug 01 07:45:30.987128 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 501/985] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:30 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:31.505516 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1723555083", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452"}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:31.571199 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] validate_networks() for None {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:45:31.846369 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1f5ad16a-d9aa-432a-a437-498516b7645f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:31.847057 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1f5ad16a-d9aa-432a-a437-498516b7645f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:31.853290 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1f5ad16a-d9aa-432a-a437-498516b7645f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:31.853755 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1f5ad16a-d9aa-432a-a437-498516b7645f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:31.854539 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1f5ad16a-d9aa-432a-a437-498516b7645f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:31.854985 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1f5ad16a-d9aa-432a-a437-498516b7645f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:31.969852 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:45:31.971015 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:45:31.971814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:45:31.972292 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:45:31.972772 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:45:31.981913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:31.982649 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:31.983692 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:31.984200 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:31.989906 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1f5ad16a-d9aa-432a-a437-498516b7645f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:32.002182 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1f5ad16a-d9aa-432a-a437-498516b7645f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1365 microversion: 2.1 time: 0.159029 Aug 01 07:45:32.002576 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Getting quotas for project 8849e0283d3543e380f3cf568cb1be2a. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:45:32.003450 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 502/986] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:31 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:45:32.006740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Getting quotas for user f9ef8ca60477408dbe7433c31a7f1a50 and project 8849e0283d3543e380f3cf568cb1be2a. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:45:32.010254 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8b6808d9-831a-4ead-887c-23fa90c6d471 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:32.012843 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8b6808d9-831a-4ead-887c-23fa90c6d471 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:32.018414 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:45:32.020546 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:45:32.023266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8b6808d9-831a-4ead-887c-23fa90c6d471 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:32.023845 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8b6808d9-831a-4ead-887c-23fa90c6d471 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:32.024738 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8b6808d9-831a-4ead-887c-23fa90c6d471 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:32.025282 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8b6808d9-831a-4ead-887c-23fa90c6d471 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:32.065413 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ba2775e5-4d3e-4a47-8940-0ee48c1698f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564255 Aug 01 07:45:32.065975 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 485/987] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:45:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:45:32.076587 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-21531ef7-2931-4cde-9cf7-cb5415992ed5 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:32.077478 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-21531ef7-2931-4cde-9cf7-cb5415992ed5 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:32.170428 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-21531ef7-2931-4cde-9cf7-cb5415992ed5 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:32.177428 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-21531ef7-2931-4cde-9cf7-cb5415992ed5 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1215 microversion: 2.1 time: 0.104566 Aug 01 07:45:32.178993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 486/988] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:32 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:45:32.203984 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8b6808d9-831a-4ead-887c-23fa90c6d471 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:32.213440 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8b6808d9-831a-4ead-887c-23fa90c6d471 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.208679 Aug 01 07:45:32.214697 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 503/989] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:32 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:32.534266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-831704b5-a894-477d-b3f0-684fe02f10b0 req-76350ce8-5e1c-4d2a-9e27-31820ec392a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78805be6-c120-4b51-b0ec-5584213faba9", "tag": "420c6c2c-7f14-4b05-8acd-b68203798cf5"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:32.546993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-831704b5-a894-477d-b3f0-684fe02f10b0 req-76350ce8-5e1c-4d2a-9e27-31820ec392a9 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:32.547664 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-831704b5-a894-477d-b3f0-684fe02f10b0 req-76350ce8-5e1c-4d2a-9e27-31820ec392a9 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:32.563538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-831704b5-a894-477d-b3f0-684fe02f10b0 req-76350ce8-5e1c-4d2a-9e27-31820ec392a9 service nova] Creating event network-changed:420c6c2c-7f14-4b05-8acd-b68203798cf5 for instance 78805be6-c120-4b51-b0ec-5584213faba9 on hv-cinder-73306 Aug 01 07:45:32.568844 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-831704b5-a894-477d-b3f0-684fe02f10b0 req-76350ce8-5e1c-4d2a-9e27-31820ec392a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041891 Aug 01 07:45:32.569432 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 487/990] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:45:33.024001 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-95e73765-15e4-4270-ac0a-8bbcb4164db3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:33.024641 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-95e73765-15e4-4270-ac0a-8bbcb4164db3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:33.032152 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-95e73765-15e4-4270-ac0a-8bbcb4164db3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:33.032696 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-95e73765-15e4-4270-ac0a-8bbcb4164db3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:33.033466 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-95e73765-15e4-4270-ac0a-8bbcb4164db3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:33.033890 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-95e73765-15e4-4270-ac0a-8bbcb4164db3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:33.186990 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-95e73765-15e4-4270-ac0a-8bbcb4164db3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:33.195731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-95e73765-15e4-4270-ac0a-8bbcb4164db3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1365 microversion: 2.1 time: 0.175583 Aug 01 07:45:33.197189 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 504/991] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:33 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:33.199964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6af9d7fc-9355-4eca-8224-cb7e46507916 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:33.200668 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6af9d7fc-9355-4eca-8224-cb7e46507916 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:33.207704 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6af9d7fc-9355-4eca-8224-cb7e46507916 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:33.208405 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6af9d7fc-9355-4eca-8224-cb7e46507916 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:33.209198 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6af9d7fc-9355-4eca-8224-cb7e46507916 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:33.209643 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6af9d7fc-9355-4eca-8224-cb7e46507916 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:33.237274 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6eac3c94-2ab5-48c7-9853-7504b42f73ad tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:33.237897 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6eac3c94-2ab5-48c7-9853-7504b42f73ad tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:33.244397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6eac3c94-2ab5-48c7-9853-7504b42f73ad tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:33.245167 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6eac3c94-2ab5-48c7-9853-7504b42f73ad tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:33.246153 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6eac3c94-2ab5-48c7-9853-7504b42f73ad tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:33.246779 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6eac3c94-2ab5-48c7-9853-7504b42f73ad tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:33.389759 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6eac3c94-2ab5-48c7-9853-7504b42f73ad tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:33.397839 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6eac3c94-2ab5-48c7-9853-7504b42f73ad tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.165428 Aug 01 07:45:33.398406 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 505/992] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:33 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:45:33.438473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-6af9d7fc-9355-4eca-8224-cb7e46507916 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:33.447193 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6af9d7fc-9355-4eca-8224-cb7e46507916 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1285 microversion: 2.1 time: 0.251406 Aug 01 07:45:33.459289 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 488/993] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:33 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:45:34.216342 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4dab4407-3ce2-43d6-b480-f41b716ff218 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:34.216874 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4dab4407-3ce2-43d6-b480-f41b716ff218 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:34.224148 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4dab4407-3ce2-43d6-b480-f41b716ff218 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:34.224776 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4dab4407-3ce2-43d6-b480-f41b716ff218 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:34.225658 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4dab4407-3ce2-43d6-b480-f41b716ff218 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:34.226292 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4dab4407-3ce2-43d6-b480-f41b716ff218 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:34.367202 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-4dab4407-3ce2-43d6-b480-f41b716ff218 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:34.374842 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4dab4407-3ce2-43d6-b480-f41b716ff218 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1365 microversion: 2.1 time: 0.162394 Aug 01 07:45:34.375445 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 506/994] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:34 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:45:34.412240 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-e05a29ad-682f-4f4b-af0e-49826d6faea2 req-69313fbf-48b7-436d-85b9-02fd843f7ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655fec6a-966b-4749-a00d-7c24e27bfaa1", "name": "network-vif-plugged", "status": "completed", "tag": "c2050d00-2a4d-480a-b950-fc9b6777da98"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:34.418789 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ecd5a949-2144-45e1-8aeb-3391674f7b45 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:34.419732 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ecd5a949-2144-45e1-8aeb-3391674f7b45 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:34.428687 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ecd5a949-2144-45e1-8aeb-3391674f7b45 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:34.429354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ecd5a949-2144-45e1-8aeb-3391674f7b45 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:34.432233 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ecd5a949-2144-45e1-8aeb-3391674f7b45 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:34.432862 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ecd5a949-2144-45e1-8aeb-3391674f7b45 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:34.437081 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-e05a29ad-682f-4f4b-af0e-49826d6faea2 req-69313fbf-48b7-436d-85b9-02fd843f7ddb service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:34.437818 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-e05a29ad-682f-4f4b-af0e-49826d6faea2 req-69313fbf-48b7-436d-85b9-02fd843f7ddb service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:34.459668 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-e05a29ad-682f-4f4b-af0e-49826d6faea2 req-69313fbf-48b7-436d-85b9-02fd843f7ddb service nova] Creating event network-vif-plugged:c2050d00-2a4d-480a-b950-fc9b6777da98 for instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 on hv-cinder-73306 Aug 01 07:45:34.465430 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-e05a29ad-682f-4f4b-af0e-49826d6faea2 req-69313fbf-48b7-436d-85b9-02fd843f7ddb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058762 Aug 01 07:45:34.467245 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 489/995] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:45:34.476778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-16b08ed5-bf98-4bbd-ba90-e86e64dd129e tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:34.478281 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-16b08ed5-bf98-4bbd-ba90-e86e64dd129e tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:34.490323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-16b08ed5-bf98-4bbd-ba90-e86e64dd129e tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:34.491087 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-16b08ed5-bf98-4bbd-ba90-e86e64dd129e tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:34.492150 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-16b08ed5-bf98-4bbd-ba90-e86e64dd129e tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:34.492702 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-16b08ed5-bf98-4bbd-ba90-e86e64dd129e tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:34.651454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-ecd5a949-2144-45e1-8aeb-3391674f7b45 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:34.661213 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ecd5a949-2144-45e1-8aeb-3391674f7b45 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.247190 Aug 01 07:45:34.662175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 507/996] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:34 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:34.819525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-16b08ed5-bf98-4bbd-ba90-e86e64dd129e tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:34.826909 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-16b08ed5-bf98-4bbd-ba90-e86e64dd129e tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1315 microversion: 2.1 time: 0.357636 Aug 01 07:45:34.827581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 490/997] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:34 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:35.265297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-7a873e7e-bed0-46b1-ae9b-e65014d32a86 req-a253e5b4-8e81-46b0-b8e5-47e895ccc48d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c59ef1-6f06-4128-9e12-140439a5dfc3", "tag": "9f2dee53-5027-4e9e-857e-c965061a5802"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:35.277628 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-7a873e7e-bed0-46b1-ae9b-e65014d32a86 req-a253e5b4-8e81-46b0-b8e5-47e895ccc48d service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:35.278342 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-7a873e7e-bed0-46b1-ae9b-e65014d32a86 req-a253e5b4-8e81-46b0-b8e5-47e895ccc48d service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:35.290400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-7a873e7e-bed0-46b1-ae9b-e65014d32a86 req-a253e5b4-8e81-46b0-b8e5-47e895ccc48d service nova] Creating event network-changed:9f2dee53-5027-4e9e-857e-c965061a5802 for instance a1c59ef1-6f06-4128-9e12-140439a5dfc3 on hv-cinder-73306 Aug 01 07:45:35.295111 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-7a873e7e-bed0-46b1-ae9b-e65014d32a86 req-a253e5b4-8e81-46b0-b8e5-47e895ccc48d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033963 Aug 01 07:45:35.295711 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 508/998] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:45:35.395546 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-560636b7-75c7-4e66-a49d-7f70683a736d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:35.396158 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-560636b7-75c7-4e66-a49d-7f70683a736d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:35.402116 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-560636b7-75c7-4e66-a49d-7f70683a736d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:35.402567 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-560636b7-75c7-4e66-a49d-7f70683a736d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:35.403383 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-560636b7-75c7-4e66-a49d-7f70683a736d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:35.403825 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-560636b7-75c7-4e66-a49d-7f70683a736d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:35.533333 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-560636b7-75c7-4e66-a49d-7f70683a736d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:35.540768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-560636b7-75c7-4e66-a49d-7f70683a736d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1365 microversion: 2.1 time: 0.149106 Aug 01 07:45:35.541258 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 491/999] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:35 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:35.680748 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:35.684911 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8e12478b-be44-41ba-9ec5-aa3e160e4cbd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:35.685612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8e12478b-be44-41ba-9ec5-aa3e160e4cbd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:35.692857 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8e12478b-be44-41ba-9ec5-aa3e160e4cbd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:35.693315 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8e12478b-be44-41ba-9ec5-aa3e160e4cbd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:35.694087 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8e12478b-be44-41ba-9ec5-aa3e160e4cbd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:35.694527 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8e12478b-be44-41ba-9ec5-aa3e160e4cbd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:35.831480 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-8e12478b-be44-41ba-9ec5-aa3e160e4cbd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:35.839144 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8e12478b-be44-41ba-9ec5-aa3e160e4cbd tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.159309 Aug 01 07:45:35.839935 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 509/1000] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:35 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:35.849540 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-896c880d-a9af-4b9a-bab1-638d57c386d3 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:35.850157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-896c880d-a9af-4b9a-bab1-638d57c386d3 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:35.856273 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-896c880d-a9af-4b9a-bab1-638d57c386d3 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:35.856730 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-896c880d-a9af-4b9a-bab1-638d57c386d3 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:35.857496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-896c880d-a9af-4b9a-bab1-638d57c386d3 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:35.857936 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-896c880d-a9af-4b9a-bab1-638d57c386d3 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:36.307652 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-896c880d-a9af-4b9a-bab1-638d57c386d3 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:36.315540 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-896c880d-a9af-4b9a-bab1-638d57c386d3 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1315 microversion: 2.1 time: 0.470100 Aug 01 07:45:36.316102 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 492/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:35 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:36.561879 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f9bfefa5-7115-4324-ae39-b1d1ddaf9463 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:36.562489 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f9bfefa5-7115-4324-ae39-b1d1ddaf9463 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:36.568987 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f9bfefa5-7115-4324-ae39-b1d1ddaf9463 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:36.569446 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f9bfefa5-7115-4324-ae39-b1d1ddaf9463 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:36.570213 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f9bfefa5-7115-4324-ae39-b1d1ddaf9463 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:36.570653 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f9bfefa5-7115-4324-ae39-b1d1ddaf9463 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:36.698319 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f9bfefa5-7115-4324-ae39-b1d1ddaf9463 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:36.705796 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f9bfefa5-7115-4324-ae39-b1d1ddaf9463 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1555 microversion: 2.1 time: 0.147814 Aug 01 07:45:36.706363 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 510/1002] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:36 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:36.726388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-99d6157c-f361-4035-98c7-f9fd665b6ee5 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:36.726896 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-99d6157c-f361-4035-98c7-f9fd665b6ee5 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:36.733233 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-99d6157c-f361-4035-98c7-f9fd665b6ee5 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:36.733679 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-99d6157c-f361-4035-98c7-f9fd665b6ee5 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:36.734433 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-99d6157c-f361-4035-98c7-f9fd665b6ee5 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:36.734868 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-99d6157c-f361-4035-98c7-f9fd665b6ee5 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:36.813163 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-99d6157c-f361-4035-98c7-f9fd665b6ee5 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090561 Aug 01 07:45:36.813858 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 493/1003] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 1 07:45:36 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:45:36.865726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1c3a7dd2-3fb0-49f2-ba13-a567f2599810 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:36.866378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1c3a7dd2-3fb0-49f2-ba13-a567f2599810 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:36.872735 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c3a7dd2-3fb0-49f2-ba13-a567f2599810 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:36.873199 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c3a7dd2-3fb0-49f2-ba13-a567f2599810 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:36.874237 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c3a7dd2-3fb0-49f2-ba13-a567f2599810 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:36.874676 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c3a7dd2-3fb0-49f2-ba13-a567f2599810 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:37.010217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1c3a7dd2-3fb0-49f2-ba13-a567f2599810 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:37.018365 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1c3a7dd2-3fb0-49f2-ba13-a567f2599810 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.160899 Aug 01 07:45:37.018938 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 511/1004] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:36 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:37.335437 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8808940d-8d2e-427a-9ae7-ff5b4b00cd44 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:37.336056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8808940d-8d2e-427a-9ae7-ff5b4b00cd44 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:37.342133 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8808940d-8d2e-427a-9ae7-ff5b4b00cd44 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:37.342593 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8808940d-8d2e-427a-9ae7-ff5b4b00cd44 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:37.343392 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8808940d-8d2e-427a-9ae7-ff5b4b00cd44 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:37.343840 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8808940d-8d2e-427a-9ae7-ff5b4b00cd44 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:37.656696 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8808940d-8d2e-427a-9ae7-ff5b4b00cd44 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:37.664941 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8808940d-8d2e-427a-9ae7-ff5b4b00cd44 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1315 microversion: 2.1 time: 0.333489 Aug 01 07:45:37.665504 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 494/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:37 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:38.038597 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-94b0b410-e2d2-4c7a-b3d8-f0af36c5069c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:38.039232 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-94b0b410-e2d2-4c7a-b3d8-f0af36c5069c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:38.045739 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-94b0b410-e2d2-4c7a-b3d8-f0af36c5069c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:38.046191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-94b0b410-e2d2-4c7a-b3d8-f0af36c5069c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:38.046945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-94b0b410-e2d2-4c7a-b3d8-f0af36c5069c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:38.047420 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-94b0b410-e2d2-4c7a-b3d8-f0af36c5069c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:38.176953 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-514ef93e-7819-4986-b8fc-1b91b394fea7 req-65a6d89a-c923-4e9f-a5fc-f347bfab2e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "655fec6a-966b-4749-a00d-7c24e27bfaa1", "tag": "c2050d00-2a4d-480a-b950-fc9b6777da98"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:38.190542 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-514ef93e-7819-4986-b8fc-1b91b394fea7 req-65a6d89a-c923-4e9f-a5fc-f347bfab2e75 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:38.191609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-514ef93e-7819-4986-b8fc-1b91b394fea7 req-65a6d89a-c923-4e9f-a5fc-f347bfab2e75 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:38.211213 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-94b0b410-e2d2-4c7a-b3d8-f0af36c5069c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:38.218186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-514ef93e-7819-4986-b8fc-1b91b394fea7 req-65a6d89a-c923-4e9f-a5fc-f347bfab2e75 service nova] Creating event network-changed:c2050d00-2a4d-480a-b950-fc9b6777da98 for instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 on hv-cinder-73306 Aug 01 07:45:38.218700 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-94b0b410-e2d2-4c7a-b3d8-f0af36c5069c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.183971 Aug 01 07:45:38.219303 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 512/1006] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:38 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:38.227767 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-514ef93e-7819-4986-b8fc-1b91b394fea7 req-65a6d89a-c923-4e9f-a5fc-f347bfab2e75 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058374 Aug 01 07:45:38.228874 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 495/1007] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:45:38.685507 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-fb7d11e0-faaa-4474-9f57-591f3c58ccdd tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:38.686110 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-fb7d11e0-faaa-4474-9f57-591f3c58ccdd tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:38.692063 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb7d11e0-faaa-4474-9f57-591f3c58ccdd tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:38.692516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb7d11e0-faaa-4474-9f57-591f3c58ccdd tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:38.693273 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb7d11e0-faaa-4474-9f57-591f3c58ccdd tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:38.693706 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-fb7d11e0-faaa-4474-9f57-591f3c58ccdd tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:38.755475 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=8 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:38.827771 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-fb7d11e0-faaa-4474-9f57-591f3c58ccdd tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:38.836346 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-fb7d11e0-faaa-4474-9f57-591f3c58ccdd tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1315 microversion: 2.1 time: 0.154681 Aug 01 07:45:38.837050 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 513/1008] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:38 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:39.242318 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-a8f9446f-e64e-4521-a33a-92ba9e63fb06 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:39.243816 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-a8f9446f-e64e-4521-a33a-92ba9e63fb06 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:39.252805 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a8f9446f-e64e-4521-a33a-92ba9e63fb06 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:39.253257 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a8f9446f-e64e-4521-a33a-92ba9e63fb06 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:39.254958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a8f9446f-e64e-4521-a33a-92ba9e63fb06 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:39.255449 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-a8f9446f-e64e-4521-a33a-92ba9e63fb06 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:39.472252 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-a8f9446f-e64e-4521-a33a-92ba9e63fb06 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:39.481038 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-a8f9446f-e64e-4521-a33a-92ba9e63fb06 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.243909 Aug 01 07:45:39.481823 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 496/1009] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:39 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:45:39.857301 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3dee9e10-b737-4c5c-8e20-7065ad1c5859 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:39.857907 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3dee9e10-b737-4c5c-8e20-7065ad1c5859 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:39.865302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3dee9e10-b737-4c5c-8e20-7065ad1c5859 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:39.865790 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3dee9e10-b737-4c5c-8e20-7065ad1c5859 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:39.866575 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3dee9e10-b737-4c5c-8e20-7065ad1c5859 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:39.867011 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3dee9e10-b737-4c5c-8e20-7065ad1c5859 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:39.885180 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=100 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:40.001108 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3dee9e10-b737-4c5c-8e20-7065ad1c5859 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:40.008558 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3dee9e10-b737-4c5c-8e20-7065ad1c5859 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1315 microversion: 2.1 time: 0.155151 Aug 01 07:45:40.009127 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 514/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:39 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:40.502873 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0a9f3327-d89e-4a0a-a8a6-469bcdf3e22e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:40.503519 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0a9f3327-d89e-4a0a-a8a6-469bcdf3e22e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:40.510116 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a9f3327-d89e-4a0a-a8a6-469bcdf3e22e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:40.510563 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a9f3327-d89e-4a0a-a8a6-469bcdf3e22e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:40.511357 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a9f3327-d89e-4a0a-a8a6-469bcdf3e22e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:40.511802 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0a9f3327-d89e-4a0a-a8a6-469bcdf3e22e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:40.644759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0a9f3327-d89e-4a0a-a8a6-469bcdf3e22e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:40.652290 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0a9f3327-d89e-4a0a-a8a6-469bcdf3e22e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.154285 Aug 01 07:45:40.652796 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 497/1011] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:40 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:41.029732 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7f90b791-0720-483e-adea-468815b390f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:41.030343 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7f90b791-0720-483e-adea-468815b390f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:41.037850 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f90b791-0720-483e-adea-468815b390f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:41.038305 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f90b791-0720-483e-adea-468815b390f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:41.039094 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f90b791-0720-483e-adea-468815b390f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:41.039529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7f90b791-0720-483e-adea-468815b390f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:41.170653 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-7f90b791-0720-483e-adea-468815b390f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:41.178896 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7f90b791-0720-483e-adea-468815b390f9 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1315 microversion: 2.1 time: 0.153016 Aug 01 07:45:41.179505 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 515/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:41 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:41.672821 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-35dee45a-c9fb-458e-bf15-75080e208f5a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:41.673428 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-35dee45a-c9fb-458e-bf15-75080e208f5a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:41.679856 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35dee45a-c9fb-458e-bf15-75080e208f5a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:41.680305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35dee45a-c9fb-458e-bf15-75080e208f5a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:41.681063 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35dee45a-c9fb-458e-bf15-75080e208f5a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:41.681498 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-35dee45a-c9fb-458e-bf15-75080e208f5a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:41.814950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-35dee45a-c9fb-458e-bf15-75080e208f5a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:41.822494 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-35dee45a-c9fb-458e-bf15-75080e208f5a tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.153720 Aug 01 07:45:41.823047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 498/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:41 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:42.199721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-cdbcd2e0-8d1c-417b-80e1-4af442197596 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:42.200332 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-cdbcd2e0-8d1c-417b-80e1-4af442197596 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:42.207297 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cdbcd2e0-8d1c-417b-80e1-4af442197596 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:42.207754 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cdbcd2e0-8d1c-417b-80e1-4af442197596 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:42.208516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cdbcd2e0-8d1c-417b-80e1-4af442197596 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:42.208954 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-cdbcd2e0-8d1c-417b-80e1-4af442197596 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:42.343975 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-cdbcd2e0-8d1c-417b-80e1-4af442197596 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:42.351942 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-cdbcd2e0-8d1c-417b-80e1-4af442197596 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1315 microversion: 2.1 time: 0.156140 Aug 01 07:45:42.352751 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 516/1014] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:42 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:42.459126 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-0d6cfc96-0018-4aa0-a87a-c4af07947a3b req-013ccc05-2b23-45cf-ba27-42f2c750b17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c59ef1-6f06-4128-9e12-140439a5dfc3", "name": "network-vif-plugged", "status": "completed", "tag": "9f2dee53-5027-4e9e-857e-c965061a5802"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:42.464392 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=4 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:42.465287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=20 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:42.473762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-0d6cfc96-0018-4aa0-a87a-c4af07947a3b req-013ccc05-2b23-45cf-ba27-42f2c750b17f service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:42.474293 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-0d6cfc96-0018-4aa0-a87a-c4af07947a3b req-013ccc05-2b23-45cf-ba27-42f2c750b17f service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:42.486865 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-0d6cfc96-0018-4aa0-a87a-c4af07947a3b req-013ccc05-2b23-45cf-ba27-42f2c750b17f service nova] Creating event network-vif-plugged:9f2dee53-5027-4e9e-857e-c965061a5802 for instance a1c59ef1-6f06-4128-9e12-140439a5dfc3 on hv-cinder-73306 Aug 01 07:45:42.493070 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-0d6cfc96-0018-4aa0-a87a-c4af07947a3b req-013ccc05-2b23-45cf-ba27-42f2c750b17f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037441 Aug 01 07:45:42.493691 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 499/1015] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:45:42.843892 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-28696f15-818d-4ed5-b961-ac22729d9e11 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:42.844428 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-28696f15-818d-4ed5-b961-ac22729d9e11 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:42.851342 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-28696f15-818d-4ed5-b961-ac22729d9e11 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:42.851802 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-28696f15-818d-4ed5-b961-ac22729d9e11 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:42.852572 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-28696f15-818d-4ed5-b961-ac22729d9e11 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:42.853017 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-28696f15-818d-4ed5-b961-ac22729d9e11 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:42.990547 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-28696f15-818d-4ed5-b961-ac22729d9e11 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:42.997967 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-28696f15-818d-4ed5-b961-ac22729d9e11 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.158032 Aug 01 07:45:42.998523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 517/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:42 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:43.373896 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c0fa654d-7916-4c3e-b44b-7f3d84c0ef96 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:43.374604 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-c0fa654d-7916-4c3e-b44b-7f3d84c0ef96 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:43.381989 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c0fa654d-7916-4c3e-b44b-7f3d84c0ef96 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:43.382454 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c0fa654d-7916-4c3e-b44b-7f3d84c0ef96 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:43.383255 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c0fa654d-7916-4c3e-b44b-7f3d84c0ef96 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:43.383701 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-c0fa654d-7916-4c3e-b44b-7f3d84c0ef96 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:43.513554 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-c0fa654d-7916-4c3e-b44b-7f3d84c0ef96 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:43.521496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c0fa654d-7916-4c3e-b44b-7f3d84c0ef96 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1315 microversion: 2.1 time: 0.152072 Aug 01 07:45:43.522054 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 500/1017] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:43 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:44.018302 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-19ce9289-5bee-4e1f-ad45-821c37157c55 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:44.018908 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-19ce9289-5bee-4e1f-ad45-821c37157c55 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:44.025395 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-19ce9289-5bee-4e1f-ad45-821c37157c55 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:44.025847 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-19ce9289-5bee-4e1f-ad45-821c37157c55 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:44.026601 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-19ce9289-5bee-4e1f-ad45-821c37157c55 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:44.027037 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-19ce9289-5bee-4e1f-ad45-821c37157c55 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:44.162432 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-19ce9289-5bee-4e1f-ad45-821c37157c55 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:44.170332 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-19ce9289-5bee-4e1f-ad45-821c37157c55 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.156033 Aug 01 07:45:44.170916 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 518/1018] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:44 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:44.518396 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-1f29f88d-7a97-4b86-93e8-a66cfb36832e req-e315826b-105e-41c2-966e-d060636b0dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78805be6-c120-4b51-b0ec-5584213faba9", "name": "network-vif-plugged", "status": "completed", "tag": "420c6c2c-7f14-4b05-8acd-b68203798cf5"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:44.528159 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-1f29f88d-7a97-4b86-93e8-a66cfb36832e req-e315826b-105e-41c2-966e-d060636b0dfa service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:44.528604 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-1f29f88d-7a97-4b86-93e8-a66cfb36832e req-e315826b-105e-41c2-966e-d060636b0dfa service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:44.539388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-1f29f88d-7a97-4b86-93e8-a66cfb36832e req-e315826b-105e-41c2-966e-d060636b0dfa service nova] Creating event network-vif-plugged:420c6c2c-7f14-4b05-8acd-b68203798cf5 for instance 78805be6-c120-4b51-b0ec-5584213faba9 on hv-cinder-73306 Aug 01 07:45:44.541564 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1fa125c7-0dd3-4858-b82b-32a8b6c8e8e8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:44.542202 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1fa125c7-0dd3-4858-b82b-32a8b6c8e8e8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:44.547017 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-1f29f88d-7a97-4b86-93e8-a66cfb36832e req-e315826b-105e-41c2-966e-d060636b0dfa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032190 Aug 01 07:45:44.547646 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 501/1019] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:45:44.549157 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1fa125c7-0dd3-4858-b82b-32a8b6c8e8e8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:44.549701 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1fa125c7-0dd3-4858-b82b-32a8b6c8e8e8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:44.550523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1fa125c7-0dd3-4858-b82b-32a8b6c8e8e8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:44.551092 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1fa125c7-0dd3-4858-b82b-32a8b6c8e8e8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:44.681164 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1fa125c7-0dd3-4858-b82b-32a8b6c8e8e8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:44.689359 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1fa125c7-0dd3-4858-b82b-32a8b6c8e8e8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1464 microversion: 2.1 time: 0.150992 Aug 01 07:45:44.690033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 519/1020] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:44 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:45:44.737128 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2d58fe33-e29b-45f4-8b23-6b39b8a94f58 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:44.737865 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2d58fe33-e29b-45f4-8b23-6b39b8a94f58 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:44.744070 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d58fe33-e29b-45f4-8b23-6b39b8a94f58 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:44.744525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d58fe33-e29b-45f4-8b23-6b39b8a94f58 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:44.745298 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d58fe33-e29b-45f4-8b23-6b39b8a94f58 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:44.745736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2d58fe33-e29b-45f4-8b23-6b39b8a94f58 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:44.773199 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2d58fe33-e29b-45f4-8b23-6b39b8a94f58 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Going to try to terminate instance {{(pid=124280) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:45:44.824266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:44.852347 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2d58fe33-e29b-45f4-8b23-6b39b8a94f58 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 204 len: 0 microversion: 2.1 time: 0.119758 Aug 01 07:45:44.852929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 502/1021] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:45:44 2022] DELETE /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:45:44.861853 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6df629ec-3f5b-43ac-a134-3c2a259104a8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:44.862455 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6df629ec-3f5b-43ac-a134-3c2a259104a8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:44.868360 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6df629ec-3f5b-43ac-a134-3c2a259104a8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:44.868808 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6df629ec-3f5b-43ac-a134-3c2a259104a8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:44.869564 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6df629ec-3f5b-43ac-a134-3c2a259104a8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:44.869997 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6df629ec-3f5b-43ac-a134-3c2a259104a8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:45.008676 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6df629ec-3f5b-43ac-a134-3c2a259104a8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:45.016090 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6df629ec-3f5b-43ac-a134-3c2a259104a8 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1470 microversion: 2.1 time: 0.158949 Aug 01 07:45:45.016656 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 520/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:44 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:45.193157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f19915d5-c064-48e1-9d8b-174182575188 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:45.193858 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f19915d5-c064-48e1-9d8b-174182575188 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:45.199880 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f19915d5-c064-48e1-9d8b-174182575188 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:45.200333 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f19915d5-c064-48e1-9d8b-174182575188 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:45.201098 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f19915d5-c064-48e1-9d8b-174182575188 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:45.201539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f19915d5-c064-48e1-9d8b-174182575188 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:45.332136 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-f19915d5-c064-48e1-9d8b-174182575188 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:45.339565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f19915d5-c064-48e1-9d8b-174182575188 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.151381 Aug 01 07:45:45.340122 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 503/1023] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:45 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:46.038048 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-83950bc8-f8aa-43b9-b6aa-584434b9efe7 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:46.038663 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-83950bc8-f8aa-43b9-b6aa-584434b9efe7 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:46.045328 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-83950bc8-f8aa-43b9-b6aa-584434b9efe7 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:46.045885 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-83950bc8-f8aa-43b9-b6aa-584434b9efe7 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:46.046676 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-83950bc8-f8aa-43b9-b6aa-584434b9efe7 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:46.047144 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-83950bc8-f8aa-43b9-b6aa-584434b9efe7 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:46.176774 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-83950bc8-f8aa-43b9-b6aa-584434b9efe7 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:46.184198 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-83950bc8-f8aa-43b9-b6aa-584434b9efe7 tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1470 microversion: 2.1 time: 0.150014 Aug 01 07:45:46.184755 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 521/1024] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:46 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:46.360999 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-2320cc99-be83-4b0a-aa48-1d30d3f0e12c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:46.361601 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-2320cc99-be83-4b0a-aa48-1d30d3f0e12c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:46.365105 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:45:46.369353 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2320cc99-be83-4b0a-aa48-1d30d3f0e12c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:46.369803 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2320cc99-be83-4b0a-aa48-1d30d3f0e12c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:46.370561 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2320cc99-be83-4b0a-aa48-1d30d3f0e12c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:46.370994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-2320cc99-be83-4b0a-aa48-1d30d3f0e12c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:46.503239 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-2320cc99-be83-4b0a-aa48-1d30d3f0e12c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:46.510471 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-2320cc99-be83-4b0a-aa48-1d30d3f0e12c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1267 microversion: 2.1 time: 0.153860 Aug 01 07:45:46.511058 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 504/1025] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:46 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:47.174473 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-3b535af0-a9c6-401f-bc8c-4865a9e6b654 req-fffb5bfa-5a06-46c2-99ff-cc0f42b51511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c59ef1-6f06-4128-9e12-140439a5dfc3", "name": "network-vif-deleted", "tag": "9f2dee53-5027-4e9e-857e-c965061a5802"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:47.184554 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-3b535af0-a9c6-401f-bc8c-4865a9e6b654 req-fffb5bfa-5a06-46c2-99ff-cc0f42b51511 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:47.185009 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-3b535af0-a9c6-401f-bc8c-4865a9e6b654 req-fffb5bfa-5a06-46c2-99ff-cc0f42b51511 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:47.196883 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-3b535af0-a9c6-401f-bc8c-4865a9e6b654 req-fffb5bfa-5a06-46c2-99ff-cc0f42b51511 service nova] Creating event network-vif-deleted:9f2dee53-5027-4e9e-857e-c965061a5802 for instance a1c59ef1-6f06-4128-9e12-140439a5dfc3 on hv-cinder-73306 Aug 01 07:45:47.203834 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-3b535af0-a9c6-401f-bc8c-4865a9e6b654 req-fffb5bfa-5a06-46c2-99ff-cc0f42b51511 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033597 Aug 01 07:45:47.204533 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 522/1026] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:45:47.205983 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-78a04545-1f0d-4952-b2a8-8f4691887a9f tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:47.206699 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-78a04545-1f0d-4952-b2a8-8f4691887a9f tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:47.213230 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78a04545-1f0d-4952-b2a8-8f4691887a9f tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:47.213714 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78a04545-1f0d-4952-b2a8-8f4691887a9f tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:47.214501 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78a04545-1f0d-4952-b2a8-8f4691887a9f tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:47.214943 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78a04545-1f0d-4952-b2a8-8f4691887a9f tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:47.305949 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-78a04545-1f0d-4952-b2a8-8f4691887a9f tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ef8ca60477408dbe7433c31a7f1a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8849e0283d3543e380f3cf568cb1be2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:47.313499 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-78a04545-1f0d-4952-b2a8-8f4691887a9f tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 200 len: 1428 microversion: 2.1 time: 0.111782 Aug 01 07:45:47.314073 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 505/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:47 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:47.532758 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-84b3befa-e72f-42d7-a71a-4721ee33dcc8 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:47.533452 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-84b3befa-e72f-42d7-a71a-4721ee33dcc8 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:47.539611 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-84b3befa-e72f-42d7-a71a-4721ee33dcc8 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:47.540061 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-84b3befa-e72f-42d7-a71a-4721ee33dcc8 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:47.540811 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-84b3befa-e72f-42d7-a71a-4721ee33dcc8 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:47.541242 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-84b3befa-e72f-42d7-a71a-4721ee33dcc8 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:47.677258 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-84b3befa-e72f-42d7-a71a-4721ee33dcc8 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:47.684839 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-84b3befa-e72f-42d7-a71a-4721ee33dcc8 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1453 microversion: 2.1 time: 0.156863 Aug 01 07:45:47.685406 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 523/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:47 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:47.705998 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-abf95ebd-ad6e-49b8-a2c3-ec8fb0bbb28f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:47.706613 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-abf95ebd-ad6e-49b8-a2c3-ec8fb0bbb28f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:47.713149 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-abf95ebd-ad6e-49b8-a2c3-ec8fb0bbb28f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:47.713613 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-abf95ebd-ad6e-49b8-a2c3-ec8fb0bbb28f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:47.714386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-abf95ebd-ad6e-49b8-a2c3-ec8fb0bbb28f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:47.714827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-abf95ebd-ad6e-49b8-a2c3-ec8fb0bbb28f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:47.846967 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-abf95ebd-ad6e-49b8-a2c3-ec8fb0bbb28f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:45:47.854437 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-abf95ebd-ad6e-49b8-a2c3-ec8fb0bbb28f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1453 microversion: 2.1 time: 0.153299 Aug 01 07:45:47.854985 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 506/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:47 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:45:48.334206 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e294b327-e26c-4157-b4d2-17cb2f0caa5b tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:45:48.335512 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e294b327-e26c-4157-b4d2-17cb2f0caa5b tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] [instance: a1c59ef1-6f06-4128-9e12-140439a5dfc3] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:45:48.341945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e294b327-e26c-4157-b4d2-17cb2f0caa5b tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:48.342400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e294b327-e26c-4157-b4d2-17cb2f0caa5b tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:48.343193 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e294b327-e26c-4157-b4d2-17cb2f0caa5b tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:48.343638 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e294b327-e26c-4157-b4d2-17cb2f0caa5b tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:48.357397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-e294b327-e26c-4157-b4d2-17cb2f0caa5b tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] HTTP exception thrown: Instance a1c59ef1-6f06-4128-9e12-140439a5dfc3 could not be found. Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e294b327-e26c-4157-b4d2-17cb2f0caa5b tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Request method failure captured: Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 HTTP/1.1 Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54SZ8rvTBAK6qmIFrIcEZYMp2WeHk2Z_fvonPbnSPQeQdDnrkRaXpnjOAdxU0TCR87MgMveuZY8bPYlfnls25CzpVYfAIVdGYbh877JZjnXYq3NvVeCZHm39izYZPlceQz1LcsQTfaJk8zm31FvxD9GDrM5rB8MUHlJ2uGsc4eXopDQ Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 8849e0283d3543e380f3cf568cb1be2a Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-VolumesNegativeTest-1538108407 Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:45:48.359043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8849e0283d3543e380f3cf568cb1be2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8849e0283d3543e380f3cf568cb1be2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8849e0283d3543e380f3cf568cb1be2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8849e0283d3543e380f3cf568cb1be2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-VolumesNegativeTest-1538108407 Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 8849e0283d3543e380f3cf568cb1be2a Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-VolumesNegativeTest-1538108407 Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-VolumesNegativeTest-1538108407-project Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: f9ef8ca60477408dbe7433c31a7f1a50 Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-VolumesNegativeTest-1538108407-project Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance a1c59ef1-6f06-4128-9e12-140439a5dfc3 could not be found. Aug 01 07:45:48.361270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': 'a1c59ef1-6f06-4128-9e12-140439a5dfc3'} Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c59ef1-6f06-4128-9e12-140439a5dfc3 could not be found. Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:45:48.362190 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c59ef1-6f06-4128-9e12-140439a5dfc3 could not be found. Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c59ef1-6f06-4128-9e12-140439a5dfc3 could not be found. Aug 01 07:45:48.363571 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:45:48.364756 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e294b327-e26c-4157-b4d2-17cb2f0caa5b tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] Returning 404 to user: Instance a1c59ef1-6f06-4128-9e12-140439a5dfc3 could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:45:48.364756 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e294b327-e26c-4157-b4d2-17cb2f0caa5b tempest-VolumesNegativeTest-1538108407 tempest-VolumesNegativeTest-1538108407-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3" status: 404 len: 111 microversion: 2.1 time: 0.030325 Aug 01 07:45:48.364756 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 524/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:45:48 2022] GET /compute/v2.1/servers/a1c59ef1-6f06-4128-9e12-140439a5dfc3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:45:49.735486 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-d0a8c324-707b-4a78-af6e-6e3254db3538 req-b1a69daf-8f1c-49c8-9eb6-c38b47037466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78805be6-c120-4b51-b0ec-5584213faba9", "tag": "420c6c2c-7f14-4b05-8acd-b68203798cf5"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:45:49.746889 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-d0a8c324-707b-4a78-af6e-6e3254db3538 req-b1a69daf-8f1c-49c8-9eb6-c38b47037466 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:45:49.747778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-d0a8c324-707b-4a78-af6e-6e3254db3538 req-b1a69daf-8f1c-49c8-9eb6-c38b47037466 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:45:49.761264 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-d0a8c324-707b-4a78-af6e-6e3254db3538 req-b1a69daf-8f1c-49c8-9eb6-c38b47037466 service nova] Creating event network-changed:420c6c2c-7f14-4b05-8acd-b68203798cf5 for instance 78805be6-c120-4b51-b0ec-5584213faba9 on hv-cinder-73306 Aug 01 07:45:49.767889 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-d0a8c324-707b-4a78-af6e-6e3254db3538 req-b1a69daf-8f1c-49c8-9eb6-c38b47037466 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035047 Aug 01 07:45:49.768448 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 507/1031] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:46:14.297115 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ee8cbe71-ddea-4b9c-a631-0a0aa3a82c34 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:14.297911 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ee8cbe71-ddea-4b9c-a631-0a0aa3a82c34 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:14.300145 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:46:14.300773 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=54 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:46:14.306708 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ee8cbe71-ddea-4b9c-a631-0a0aa3a82c34 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:14.307213 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ee8cbe71-ddea-4b9c-a631-0a0aa3a82c34 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:14.307963 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ee8cbe71-ddea-4b9c-a631-0a0aa3a82c34 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:14.308400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ee8cbe71-ddea-4b9c-a631-0a0aa3a82c34 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:14.334820 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ee8cbe71-ddea-4b9c-a631-0a0aa3a82c34 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1/ips" status: 200 len: 149 microversion: 2.1 time: 0.041527 Aug 01 07:46:14.335399 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 525/1032] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 1 07:46:14 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:46:14.344549 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=6 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:46:14.345375 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=26 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:46:14.349630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-514485f2-3715-4922-90ec-d71f790eb156 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5977ae6-4b09-4164-a8ec-89a84d6c8100"}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:46:14.352003 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-514485f2-3715-4922-90ec-d71f790eb156 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:14.358776 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-514485f2-3715-4922-90ec-d71f790eb156 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:14.359262 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-514485f2-3715-4922-90ec-d71f790eb156 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:14.360538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-514485f2-3715-4922-90ec-d71f790eb156 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:14.361055 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-514485f2-3715-4922-90ec-d71f790eb156 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:14.438078 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-514485f2-3715-4922-90ec-d71f790eb156 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Invalid volume: volume c5977ae6-4b09-4164-a8ec-89a84d6c8100 is already attached to instances: d7638196-f31a-47de-8500-475937e17054 Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-514485f2-3715-4922-90ec-d71f790eb156 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: POST /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1/os-volume_attachments HTTP/1.1 Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 74 Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:46:14.440935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {"volumeAttachment": {"volumeId": "c5977ae6-4b09-4164-a8ec-89a84d6c8100"}} Aug 01 07:46:14.442640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Invalid volume: volume c5977ae6-4b09-4164-a8ec-89a84d6c8100 is already attached to instances: d7638196-f31a-47de-8500-475937e17054 Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'server_id': '655fec6a-966b-4749-a00d-7c24e27bfaa1', 'body': {'volumeAttachment': {'volumeId': 'c5977ae6-4b09-4164-a8ec-89a84d6c8100'}}} Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c5977ae6-4b09-4164-a8ec-89a84d6c8100 is already attached to instances: d7638196-f31a-47de-8500-475937e17054 Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:14.443522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c5977ae6-4b09-4164-a8ec-89a84d6c8100 is already attached to instances: d7638196-f31a-47de-8500-475937e17054 Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:46:14.445014 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:46:14.446627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:46:14.446627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:46:14.446627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:46:14.446627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c5977ae6-4b09-4164-a8ec-89a84d6c8100 is already attached to instances: d7638196-f31a-47de-8500-475937e17054 Aug 01 07:46:14.446627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:14.446627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-514485f2-3715-4922-90ec-d71f790eb156 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 400 to user: Invalid volume: volume c5977ae6-4b09-4164-a8ec-89a84d6c8100 is already attached to instances: d7638196-f31a-47de-8500-475937e17054 {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:46:14.446627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-514485f2-3715-4922-90ec-d71f790eb156 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099600 Aug 01 07:46:14.446627 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 508/1033] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:46:14 2022] POST /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 07:46:14.451158 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7b04928d-0eb0-446c-8ef5-f2a9bec7072a tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:14.451657 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7b04928d-0eb0-446c-8ef5-f2a9bec7072a tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:14.458166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b04928d-0eb0-446c-8ef5-f2a9bec7072a tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:14.458609 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b04928d-0eb0-446c-8ef5-f2a9bec7072a tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:14.459396 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b04928d-0eb0-446c-8ef5-f2a9bec7072a tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:14.459829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7b04928d-0eb0-446c-8ef5-f2a9bec7072a tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:14.485326 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7b04928d-0eb0-446c-8ef5-f2a9bec7072a tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:46:14.561872 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7b04928d-0eb0-446c-8ef5-f2a9bec7072a tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 204 len: 0 microversion: 2.1 time: 0.114261 Aug 01 07:46:14.562367 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 526/1034] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:46:14 2022] DELETE /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:46:14.571165 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b4a7bc8f-ed07-4c68-820e-15421e17e341 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:14.571778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b4a7bc8f-ed07-4c68-820e-15421e17e341 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:14.581397 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b4a7bc8f-ed07-4c68-820e-15421e17e341 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:14.581852 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b4a7bc8f-ed07-4c68-820e-15421e17e341 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:14.582612 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b4a7bc8f-ed07-4c68-820e-15421e17e341 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:14.583045 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b4a7bc8f-ed07-4c68-820e-15421e17e341 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:14.712435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b4a7bc8f-ed07-4c68-820e-15421e17e341 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:14.720096 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b4a7bc8f-ed07-4c68-820e-15421e17e341 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1679 microversion: 2.1 time: 0.152738 Aug 01 07:46:14.720667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 509/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:14 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:46:15.741901 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-380cf708-004a-46c0-b7f3-3bc086b181e1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:15.742591 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-380cf708-004a-46c0-b7f3-3bc086b181e1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:15.749410 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-380cf708-004a-46c0-b7f3-3bc086b181e1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:15.749858 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-380cf708-004a-46c0-b7f3-3bc086b181e1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:15.751276 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-380cf708-004a-46c0-b7f3-3bc086b181e1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:15.751862 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-380cf708-004a-46c0-b7f3-3bc086b181e1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:15.881887 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-380cf708-004a-46c0-b7f3-3bc086b181e1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:15.889386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-380cf708-004a-46c0-b7f3-3bc086b181e1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1679 microversion: 2.1 time: 0.151709 Aug 01 07:46:15.889951 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 527/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:15 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:16.912075 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ff5e8b55-847b-4ff2-a2bc-b67efa263c2b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:16.912828 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ff5e8b55-847b-4ff2-a2bc-b67efa263c2b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:16.919310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ff5e8b55-847b-4ff2-a2bc-b67efa263c2b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:16.919768 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ff5e8b55-847b-4ff2-a2bc-b67efa263c2b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:16.920537 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ff5e8b55-847b-4ff2-a2bc-b67efa263c2b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:16.920995 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ff5e8b55-847b-4ff2-a2bc-b67efa263c2b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:17.136640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ff5e8b55-847b-4ff2-a2bc-b67efa263c2b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:17.144071 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ff5e8b55-847b-4ff2-a2bc-b67efa263c2b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 200 len: 1679 microversion: 2.1 time: 0.235875 Aug 01 07:46:17.144680 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 510/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:16 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 1679 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:17.410610 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-8f86c79c-0f44-49b7-a0b0-3bbb664c71d2 req-3e28a5c2-ae99-4ff5-91af-9c01f889cbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655fec6a-966b-4749-a00d-7c24e27bfaa1", "name": "network-vif-deleted", "tag": "c2050d00-2a4d-480a-b950-fc9b6777da98"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:46:17.420614 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-8f86c79c-0f44-49b7-a0b0-3bbb664c71d2 req-3e28a5c2-ae99-4ff5-91af-9c01f889cbdf service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:17.420992 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-8f86c79c-0f44-49b7-a0b0-3bbb664c71d2 req-3e28a5c2-ae99-4ff5-91af-9c01f889cbdf service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:17.435364 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-8f86c79c-0f44-49b7-a0b0-3bbb664c71d2 req-3e28a5c2-ae99-4ff5-91af-9c01f889cbdf service nova] Creating event network-vif-deleted:c2050d00-2a4d-480a-b950-fc9b6777da98 for instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 on hv-cinder-73306 Aug 01 07:46:17.441079 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-8f86c79c-0f44-49b7-a0b0-3bbb664c71d2 req-3e28a5c2-ae99-4ff5-91af-9c01f889cbdf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034773 Aug 01 07:46:17.444678 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 528/1038] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:46:18.165813 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b8fd55a6-950b-4a45-ad0d-88a778a6b8da tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:18.166496 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b8fd55a6-950b-4a45-ad0d-88a778a6b8da tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:18.174100 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b8fd55a6-950b-4a45-ad0d-88a778a6b8da tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:18.174558 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b8fd55a6-950b-4a45-ad0d-88a778a6b8da tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:18.175505 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b8fd55a6-950b-4a45-ad0d-88a778a6b8da tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:18.175894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b8fd55a6-950b-4a45-ad0d-88a778a6b8da tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:18.190395 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-b8fd55a6-950b-4a45-ad0d-88a778a6b8da tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b8fd55a6-950b-4a45-ad0d-88a778a6b8da tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 HTTP/1.1 Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:46:18.191994 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:46:18.193591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '655fec6a-966b-4749-a00d-7c24e27bfaa1'} Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:46:18.194778 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:46:18.196343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:18.197758 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b8fd55a6-950b-4a45-ad0d-88a778a6b8da tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:46:18.197758 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b8fd55a6-950b-4a45-ad0d-88a778a6b8da tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 404 len: 111 microversion: 2.1 time: 0.031517 Aug 01 07:46:18.197758 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 511/1039] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:18 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:46:18.202934 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6a78c687-cd5a-489b-a849-2bfb65b97056 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '.version_select at 0x7fd018b0b280>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:18.224564 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6a78c687-cd5a-489b-a849-2bfb65b97056 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-935126645" status: 202 len: 0 microversion: 2.1 time: 0.025656 Aug 01 07:46:18.225069 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 529/1040] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Aug 1 07:46:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-935126645 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:46:18.891735 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6fea9a75-4ace-41a3-a317-11ec9f837963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:18.892231 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6fea9a75-4ace-41a3-a317-11ec9f837963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:18.898154 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6fea9a75-4ace-41a3-a317-11ec9f837963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:18.898605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6fea9a75-4ace-41a3-a317-11ec9f837963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:18.899392 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6fea9a75-4ace-41a3-a317-11ec9f837963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:18.899829 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6fea9a75-4ace-41a3-a317-11ec9f837963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:18.978565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-6fea9a75-4ace-41a3-a317-11ec9f837963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lazy-loading 'services' on Instance uuid d7638196-f31a-47de-8500-475937e17054 {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:46:19.048557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6fea9a75-4ace-41a3-a317-11ec9f837963 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/os-volume_attachments/c5977ae6-4b09-4164-a8ec-89a84d6c8100" status: 202 len: 0 microversion: 2.1 time: 0.160983 Aug 01 07:46:19.049163 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 512/1041] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:46:18 2022] DELETE /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/os-volume_attachments/c5977ae6-4b09-4164-a8ec-89a84d6c8100 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:46:19.059111 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-64c137ea-ad64-4049-a873-bc8739e581ea tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:19.061350 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-64c137ea-ad64-4049-a873-bc8739e581ea tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:19.069459 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-64c137ea-ad64-4049-a873-bc8739e581ea tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:19.070043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-64c137ea-ad64-4049-a873-bc8739e581ea tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:19.071039 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-64c137ea-ad64-4049-a873-bc8739e581ea tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:19.071503 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-64c137ea-ad64-4049-a873-bc8739e581ea tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:19.105348 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-64c137ea-ad64-4049-a873-bc8739e581ea tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051605 Aug 01 07:46:19.105898 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 530/1042] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:46:19 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:46:20.119179 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-63234e5a-1853-49ef-b41d-ddf2eafa1111 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:20.121525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-63234e5a-1853-49ef-b41d-ddf2eafa1111 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:20.128724 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-63234e5a-1853-49ef-b41d-ddf2eafa1111 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:20.129183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-63234e5a-1853-49ef-b41d-ddf2eafa1111 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:20.129956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-63234e5a-1853-49ef-b41d-ddf2eafa1111 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:20.130402 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-63234e5a-1853-49ef-b41d-ddf2eafa1111 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:20.159216 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-63234e5a-1853-49ef-b41d-ddf2eafa1111 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044855 Aug 01 07:46:20.159766 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 513/1043] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:46:20 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 07:46:20.220146 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a7b4c934-b3ce-4d76-8fd1-7ce720077ee3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:20.220694 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a7b4c934-b3ce-4d76-8fd1-7ce720077ee3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:20.227043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a7b4c934-b3ce-4d76-8fd1-7ce720077ee3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:20.227528 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a7b4c934-b3ce-4d76-8fd1-7ce720077ee3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:20.228293 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a7b4c934-b3ce-4d76-8fd1-7ce720077ee3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:20.228739 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a7b4c934-b3ce-4d76-8fd1-7ce720077ee3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:20.254099 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a7b4c934-b3ce-4d76-8fd1-7ce720077ee3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:46:20.327300 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a7b4c934-b3ce-4d76-8fd1-7ce720077ee3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 204 len: 0 microversion: 2.1 time: 0.110543 Aug 01 07:46:20.328972 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 531/1044] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:46:20 2022] DELETE /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:46:20.337212 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-964b7e2f-011c-4b3b-90bd-db05bad53f7f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:20.337827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-964b7e2f-011c-4b3b-90bd-db05bad53f7f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:20.343953 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-964b7e2f-011c-4b3b-90bd-db05bad53f7f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:20.344412 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-964b7e2f-011c-4b3b-90bd-db05bad53f7f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:20.345181 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-964b7e2f-011c-4b3b-90bd-db05bad53f7f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:20.345623 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-964b7e2f-011c-4b3b-90bd-db05bad53f7f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:20.477952 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-964b7e2f-011c-4b3b-90bd-db05bad53f7f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:20.486331 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-964b7e2f-011c-4b3b-90bd-db05bad53f7f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1680 microversion: 2.1 time: 0.152700 Aug 01 07:46:20.486571 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 514/1045] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:20 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:21.507897 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c009d9df-6b6b-428f-b753-5dc170f7ac22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:21.508657 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-c009d9df-6b6b-428f-b753-5dc170f7ac22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:21.515032 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c009d9df-6b6b-428f-b753-5dc170f7ac22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:21.515513 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c009d9df-6b6b-428f-b753-5dc170f7ac22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:21.516991 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c009d9df-6b6b-428f-b753-5dc170f7ac22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:21.517432 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-c009d9df-6b6b-428f-b753-5dc170f7ac22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:21.647542 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-c009d9df-6b6b-428f-b753-5dc170f7ac22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:21.654922 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c009d9df-6b6b-428f-b753-5dc170f7ac22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1680 microversion: 2.1 time: 0.151235 Aug 01 07:46:21.655512 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 532/1046] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:21 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:22.676539 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-1d36fb65-03b9-47af-b6c3-c625f7e539a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:22.677164 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-1d36fb65-03b9-47af-b6c3-c625f7e539a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:22.683654 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d36fb65-03b9-47af-b6c3-c625f7e539a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:22.684112 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d36fb65-03b9-47af-b6c3-c625f7e539a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:22.684888 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d36fb65-03b9-47af-b6c3-c625f7e539a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:22.685333 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-1d36fb65-03b9-47af-b6c3-c625f7e539a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:23.194139 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-1d36fb65-03b9-47af-b6c3-c625f7e539a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:23.201816 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-1d36fb65-03b9-47af-b6c3-c625f7e539a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 200 len: 1680 microversion: 2.1 time: 0.529644 Aug 01 07:46:23.202388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 515/1047] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:22 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 1680 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:23.583189 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-12d974e1-b61b-4460-8941-77a6bfb5ccb0 req-eedbdff2-afc6-4b35-b6c3-8212f5696960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7638196-f31a-47de-8500-475937e17054", "name": "network-vif-deleted", "tag": "f1cb5bc6-2ff9-46dd-a83e-c1077f7618f6"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:46:23.596348 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-12d974e1-b61b-4460-8941-77a6bfb5ccb0 req-eedbdff2-afc6-4b35-b6c3-8212f5696960 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:23.597362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-12d974e1-b61b-4460-8941-77a6bfb5ccb0 req-eedbdff2-afc6-4b35-b6c3-8212f5696960 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:23.612797 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-12d974e1-b61b-4460-8941-77a6bfb5ccb0 req-eedbdff2-afc6-4b35-b6c3-8212f5696960 service nova] Creating event network-vif-deleted:f1cb5bc6-2ff9-46dd-a83e-c1077f7618f6 for instance d7638196-f31a-47de-8500-475937e17054 on hv-cinder-73306 Aug 01 07:46:23.618148 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-12d974e1-b61b-4460-8941-77a6bfb5ccb0 req-eedbdff2-afc6-4b35-b6c3-8212f5696960 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040081 Aug 01 07:46:23.618750 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 533/1048] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:46:24.223644 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-972f9fab-b0a8-4df6-9518-81dda72895f8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:24.224257 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-972f9fab-b0a8-4df6-9518-81dda72895f8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:24.231214 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-972f9fab-b0a8-4df6-9518-81dda72895f8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:24.231665 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-972f9fab-b0a8-4df6-9518-81dda72895f8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:24.232435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-972f9fab-b0a8-4df6-9518-81dda72895f8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:24.232871 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-972f9fab-b0a8-4df6-9518-81dda72895f8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:24.249300 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-972f9fab-b0a8-4df6-9518-81dda72895f8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-972f9fab-b0a8-4df6-9518-81dda72895f8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 HTTP/1.1 Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:46:24.251605 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:46:24.253118 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'd7638196-f31a-47de-8500-475937e17054'} Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:46:24.253950 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:46:24.257047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:46:24.259183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-972f9fab-b0a8-4df6-9518-81dda72895f8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:46:24.259183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-972f9fab-b0a8-4df6-9518-81dda72895f8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 404 len: 111 microversion: 2.1 time: 0.033486 Aug 01 07:46:24.259183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 516/1049] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:24 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:46:24.263629 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-c13315aa-5ae6-406e-a405-6386b6b9249e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '.version_select at 0x7fd018d678b0>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:24.282739 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-c13315aa-5ae6-406e-a405-6386b6b9249e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-648604514" status: 202 len: 0 microversion: 2.1 time: 0.023245 Aug 01 07:46:24.283408 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 534/1050] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Aug 1 07:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-648604514 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 07:46:24.964541 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-82b4c1c1-8772-4b96-964b-4d4df553f902 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: .version_select at 0x7fd018a09790>, body: {"keypair": {"name": "tempest-keypair-343838746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5yLBEhB5CkIotUbLotVeX+lAL3tQqo5ivh8KaOLydVV0bR47GTFwu0hmrd70gi/p7sCI+OmKjJuy65EgLYY0Xdv1FXCzJm7wM6WghkIkDifUDK4OrPljpRmb/Q+ZpC6Q=="}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:46:24.981860 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-82b4c1c1-8772-4b96-964b-4d4df553f902 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for project 49e0013064fc495285dad557b0beef7d. Resources: {'key_pairs'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:46:24.986743 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-82b4c1c1-8772-4b96-964b-4d4df553f902 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for user 1ba46a929ed54c51a33662367289eee5 and project 49e0013064fc495285dad557b0beef7d. Resources: {'key_pairs'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:46:25.013514 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-82b4c1c1-8772-4b96-964b-4d4df553f902 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055376 Aug 01 07:46:25.014491 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 517/1051] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 1 07:46:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:46:26.323789 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1192479947", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d0500b7-ad41-4ce8-9297-aa02b3bcbfff"}], "security_groups": [{"name": "tempest-securitygroup--530528063"}], "key_name": "tempest-keypair-343838746", "user_data": "}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:46:26.426354 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.network.neutron [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] validate_networks() for [('4d0500b7-ad41-4ce8-9297-aa02b3bcbfff', None, None, None, None, None)] {{(pid=124279) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:46:26.789502 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Flavor limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:46:26.789955 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Image limits 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:46:26.790425 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Flavor pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:46:26.790829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Image pref 0:0:0 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:46:26.791298 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.virt.hardware [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:46:26.799986 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:26.800429 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:26.801246 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:26.801677 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:26.818455 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for project 49e0013064fc495285dad557b0beef7d. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:46:26.822340 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for user 1ba46a929ed54c51a33662367289eee5 and project 49e0013064fc495285dad557b0beef7d. Resources: {'cores', 'instances', 'ram'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:46:26.833626 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Going to run 1 instances... {{(pid=124279) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:46:26.835997 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:46:26.882193 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-ad353cc3-e998-49b8-9112-a7e00172d721 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.563389 Aug 01 07:46:26.882830 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 535/1052] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:46:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:46:26.894704 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d3f3ae6e-5246-46c0-b21f-4def20884514 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:26.895414 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d3f3ae6e-5246-46c0-b21f-4def20884514 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:26.953866 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-d3f3ae6e-5246-46c0-b21f-4def20884514 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:26.962488 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d3f3ae6e-5246-46c0-b21f-4def20884514 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1241 microversion: 2.1 time: 0.072698 Aug 01 07:46:26.963041 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 518/1053] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:26 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:27.984953 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6f348e3a-024f-4f20-9b70-76f64490be22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:27.985760 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6f348e3a-024f-4f20-9b70-76f64490be22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:28.001700 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6f348e3a-024f-4f20-9b70-76f64490be22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:28.002157 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6f348e3a-024f-4f20-9b70-76f64490be22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:28.003026 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6f348e3a-024f-4f20-9b70-76f64490be22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:28.004244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6f348e3a-024f-4f20-9b70-76f64490be22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:28.069989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6f348e3a-024f-4f20-9b70-76f64490be22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:28.077358 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6f348e3a-024f-4f20-9b70-76f64490be22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1299 microversion: 2.1 time: 0.098105 Aug 01 07:46:28.078135 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 536/1054] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:27 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:29.098925 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-955f1ef8-909a-404b-a67c-94a437d0b7e8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:29.099580 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-955f1ef8-909a-404b-a67c-94a437d0b7e8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:29.106130 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-955f1ef8-909a-404b-a67c-94a437d0b7e8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:29.106592 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-955f1ef8-909a-404b-a67c-94a437d0b7e8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:29.107404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-955f1ef8-909a-404b-a67c-94a437d0b7e8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:29.107847 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-955f1ef8-909a-404b-a67c-94a437d0b7e8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:29.127410 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-fabade0e-5287-496c-a36f-66ac61084421 req-82b3a165-56d5-4b31-b405-4cc22797af84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d523a7-6f42-441f-9e01-bf42a5a55e76", "tag": "d5715865-ad95-499b-a4ce-79063a992ba6"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:46:29.139697 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-fabade0e-5287-496c-a36f-66ac61084421 req-82b3a165-56d5-4b31-b405-4cc22797af84 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:29.141031 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-fabade0e-5287-496c-a36f-66ac61084421 req-82b3a165-56d5-4b31-b405-4cc22797af84 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:29.153053 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-fabade0e-5287-496c-a36f-66ac61084421 req-82b3a165-56d5-4b31-b405-4cc22797af84 service nova] Creating event network-changed:d5715865-ad95-499b-a4ce-79063a992ba6 for instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 on hv-cinder-73306 Aug 01 07:46:29.159507 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-fabade0e-5287-496c-a36f-66ac61084421 req-82b3a165-56d5-4b31-b405-4cc22797af84 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039880 Aug 01 07:46:29.160678 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 537/1055] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:46:29.336642 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-955f1ef8-909a-404b-a67c-94a437d0b7e8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:29.344704 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-955f1ef8-909a-404b-a67c-94a437d0b7e8 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1366 microversion: 2.1 time: 0.249863 Aug 01 07:46:29.345273 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 519/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:29 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:30.366985 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-f5289a78-edf4-474f-86ee-5b4eda28a165 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:30.367633 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-f5289a78-edf4-474f-86ee-5b4eda28a165 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:30.374028 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f5289a78-edf4-474f-86ee-5b4eda28a165 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:30.374474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f5289a78-edf4-474f-86ee-5b4eda28a165 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:30.375831 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f5289a78-edf4-474f-86ee-5b4eda28a165 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:30.376272 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-f5289a78-edf4-474f-86ee-5b4eda28a165 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:30.504157 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-f5289a78-edf4-474f-86ee-5b4eda28a165 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:30.511612 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-f5289a78-edf4-474f-86ee-5b4eda28a165 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1366 microversion: 2.1 time: 0.149490 Aug 01 07:46:30.512172 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 538/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:30 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:31.532105 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-0efeb689-5495-4900-991e-1df33da1c4aa tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:31.532807 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-0efeb689-5495-4900-991e-1df33da1c4aa tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:31.539386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0efeb689-5495-4900-991e-1df33da1c4aa tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:31.539844 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0efeb689-5495-4900-991e-1df33da1c4aa tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:31.540610 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0efeb689-5495-4900-991e-1df33da1c4aa tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:31.541053 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-0efeb689-5495-4900-991e-1df33da1c4aa tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:31.669817 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-0efeb689-5495-4900-991e-1df33da1c4aa tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:31.677917 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-0efeb689-5495-4900-991e-1df33da1c4aa tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1366 microversion: 2.1 time: 0.150090 Aug 01 07:46:31.678476 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 520/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:31 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:32.699314 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-aac8c2e5-4f2e-4162-a246-8c4189723676 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:32.699922 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-aac8c2e5-4f2e-4162-a246-8c4189723676 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:32.707199 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aac8c2e5-4f2e-4162-a246-8c4189723676 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:32.707651 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aac8c2e5-4f2e-4162-a246-8c4189723676 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:32.708417 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aac8c2e5-4f2e-4162-a246-8c4189723676 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:32.708853 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-aac8c2e5-4f2e-4162-a246-8c4189723676 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:32.848116 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-aac8c2e5-4f2e-4162-a246-8c4189723676 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:32.855408 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-aac8c2e5-4f2e-4162-a246-8c4189723676 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1366 microversion: 2.1 time: 0.160017 Aug 01 07:46:32.855968 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 539/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:32 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:33.876609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-8021865e-3190-420e-9842-329ae0eb874b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:33.877213 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-8021865e-3190-420e-9842-329ae0eb874b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:33.883689 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8021865e-3190-420e-9842-329ae0eb874b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:33.884136 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8021865e-3190-420e-9842-329ae0eb874b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:33.884896 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8021865e-3190-420e-9842-329ae0eb874b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:33.885326 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-8021865e-3190-420e-9842-329ae0eb874b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:34.012296 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-8021865e-3190-420e-9842-329ae0eb874b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:34.019732 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-8021865e-3190-420e-9842-329ae0eb874b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1366 microversion: 2.1 time: 0.148000 Aug 01 07:46:34.020290 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 521/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:33 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:34.831932 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-755f7c7a-48f8-4afb-b032-12ac30251b69 req-495600d1-d75d-4a0e-9bfe-319a1b6443e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d523a7-6f42-441f-9e01-bf42a5a55e76", "name": "network-vif-plugged", "status": "completed", "tag": "d5715865-ad95-499b-a4ce-79063a992ba6"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:46:34.842651 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-755f7c7a-48f8-4afb-b032-12ac30251b69 req-495600d1-d75d-4a0e-9bfe-319a1b6443e3 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:34.843770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-755f7c7a-48f8-4afb-b032-12ac30251b69 req-495600d1-d75d-4a0e-9bfe-319a1b6443e3 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:34.855264 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-755f7c7a-48f8-4afb-b032-12ac30251b69 req-495600d1-d75d-4a0e-9bfe-319a1b6443e3 service nova] Creating event network-vif-plugged:d5715865-ad95-499b-a4ce-79063a992ba6 for instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 on hv-cinder-73306 Aug 01 07:46:34.860038 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-755f7c7a-48f8-4afb-b032-12ac30251b69 req-495600d1-d75d-4a0e-9bfe-319a1b6443e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032388 Aug 01 07:46:34.860662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 540/1061] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:46:35.040756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ee7d2b3d-d84d-47d9-9696-6104d84ec75e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:35.041365 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ee7d2b3d-d84d-47d9-9696-6104d84ec75e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:35.047684 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ee7d2b3d-d84d-47d9-9696-6104d84ec75e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:35.048135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ee7d2b3d-d84d-47d9-9696-6104d84ec75e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:35.049010 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ee7d2b3d-d84d-47d9-9696-6104d84ec75e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:35.049461 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ee7d2b3d-d84d-47d9-9696-6104d84ec75e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:35.181562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ee7d2b3d-d84d-47d9-9696-6104d84ec75e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:35.190220 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ee7d2b3d-d84d-47d9-9696-6104d84ec75e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1366 microversion: 2.1 time: 0.153737 Aug 01 07:46:35.190804 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 522/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:35 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:36.212401 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-682ac0b7-320a-4e5b-994f-63771ff3dc5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:36.213128 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-682ac0b7-320a-4e5b-994f-63771ff3dc5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:36.220186 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-682ac0b7-320a-4e5b-994f-63771ff3dc5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:36.220573 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-682ac0b7-320a-4e5b-994f-63771ff3dc5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:36.221328 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-682ac0b7-320a-4e5b-994f-63771ff3dc5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:36.221763 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-682ac0b7-320a-4e5b-994f-63771ff3dc5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:36.357159 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-682ac0b7-320a-4e5b-994f-63771ff3dc5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:36.364754 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-682ac0b7-320a-4e5b-994f-63771ff3dc5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1366 microversion: 2.1 time: 0.156996 Aug 01 07:46:36.365317 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 541/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:36 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:37.385954 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-62e114ae-96a8-42b7-ab97-251ba8d1071d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:37.386567 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-62e114ae-96a8-42b7-ab97-251ba8d1071d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:37.388970 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=6 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:46:37.394316 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-62e114ae-96a8-42b7-ab97-251ba8d1071d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:37.394765 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-62e114ae-96a8-42b7-ab97-251ba8d1071d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:37.395546 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-62e114ae-96a8-42b7-ab97-251ba8d1071d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:37.395978 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-62e114ae-96a8-42b7-ab97-251ba8d1071d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:37.525974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-62e114ae-96a8-42b7-ab97-251ba8d1071d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:46:37.534369 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-62e114ae-96a8-42b7-ab97-251ba8d1071d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1556 microversion: 2.1 time: 0.152289 Aug 01 07:46:37.534964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 523/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:46:37 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:46:37.554656 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-4619c1a4-e214-4b5c-82e1-0969a03839f9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:46:37.555207 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-4619c1a4-e214-4b5c-82e1-0969a03839f9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:46:37.557162 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:46:37.557811 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=6 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:46:37.564211 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4619c1a4-e214-4b5c-82e1-0969a03839f9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:37.564655 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4619c1a4-e214-4b5c-82e1-0969a03839f9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:37.565435 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4619c1a4-e214-4b5c-82e1-0969a03839f9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:37.565866 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-4619c1a4-e214-4b5c-82e1-0969a03839f9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:37.642188 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-4619c1a4-e214-4b5c-82e1-0969a03839f9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091273 Aug 01 07:46:37.642786 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 542/1065] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 1 07:46:37 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:46:38.763422 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-e770598a-ca7b-499c-bcf9-04a6f35810fc req-a87daaab-ebae-476e-967e-5a32ab446307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d523a7-6f42-441f-9e01-bf42a5a55e76", "tag": "d5715865-ad95-499b-a4ce-79063a992ba6"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:46:38.773747 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-e770598a-ca7b-499c-bcf9-04a6f35810fc req-a87daaab-ebae-476e-967e-5a32ab446307 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:46:38.774205 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-e770598a-ca7b-499c-bcf9-04a6f35810fc req-a87daaab-ebae-476e-967e-5a32ab446307 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:46:38.787145 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-e770598a-ca7b-499c-bcf9-04a6f35810fc req-a87daaab-ebae-476e-967e-5a32ab446307 service nova] Creating event network-changed:d5715865-ad95-499b-a4ce-79063a992ba6 for instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 on hv-cinder-73306 Aug 01 07:46:38.792111 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-e770598a-ca7b-499c-bcf9-04a6f35810fc req-a87daaab-ebae-476e-967e-5a32ab446307 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032402 Aug 01 07:46:38.792886 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 524/1066] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:14.861485 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:47:14.862389 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:47:14.866339 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-0800e900-560d-4eb5-b25c-30a630b92b7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:14.866862 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-0800e900-560d-4eb5-b25c-30a630b92b7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:14.875185 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0800e900-560d-4eb5-b25c-30a630b92b7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:14.875637 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0800e900-560d-4eb5-b25c-30a630b92b7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:14.876398 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0800e900-560d-4eb5-b25c-30a630b92b7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:14.876831 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-0800e900-560d-4eb5-b25c-30a630b92b7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:14.902238 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-0800e900-560d-4eb5-b25c-30a630b92b7b tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/ips" status: 200 len: 149 microversion: 2.1 time: 0.042116 Aug 01 07:47:14.902813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 543/1067] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 1 07:47:14 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:16.221694 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:47:16.222573 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:47:16.226898 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-f6bcc88f-5bc6-45f6-b638-1621185c37a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3c600a0-ec73-45bb-b32a-e61b894ed5a0"}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:16.229325 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-f6bcc88f-5bc6-45f6-b638-1621185c37a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:16.236739 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f6bcc88f-5bc6-45f6-b638-1621185c37a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:16.237192 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f6bcc88f-5bc6-45f6-b638-1621185c37a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:16.238110 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f6bcc88f-5bc6-45f6-b638-1621185c37a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:16.238550 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-f6bcc88f-5bc6-45f6-b638-1621185c37a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:16.678942 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-f6bcc88f-5bc6-45f6-b638-1621185c37a7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458567 Aug 01 07:47:16.684874 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 525/1068] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:47:16 2022] POST /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:24.196108 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8f54792c-7d1f-4fea-9b2b-138e425031c3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3c600a0-ec73-45bb-b32a-e61b894ed5a0"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:24.198434 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-8f54792c-7d1f-4fea-9b2b-138e425031c3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:24.204998 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8f54792c-7d1f-4fea-9b2b-138e425031c3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:24.205453 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8f54792c-7d1f-4fea-9b2b-138e425031c3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:24.206270 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8f54792c-7d1f-4fea-9b2b-138e425031c3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:24.206710 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-8f54792c-7d1f-4fea-9b2b-138e425031c3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:24.334743 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-8f54792c-7d1f-4fea-9b2b-138e425031c3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Invalid volume: volume f3c600a0-ec73-45bb-b32a-e61b894ed5a0 is already attached to instances: e3d523a7-6f42-441f-9e01-bf42a5a55e76 Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8f54792c-7d1f-4fea-9b2b-138e425031c3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: POST /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments HTTP/1.1 Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 74 Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:47:24.336514 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {"volumeAttachment": {"volumeId": "f3c600a0-ec73-45bb-b32a-e61b894ed5a0"}} Aug 01 07:47:24.338240 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Invalid volume: volume f3c600a0-ec73-45bb-b32a-e61b894ed5a0 is already attached to instances: e3d523a7-6f42-441f-9e01-bf42a5a55e76 Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'server_id': 'e3d523a7-6f42-441f-9e01-bf42a5a55e76', 'body': {'volumeAttachment': {'volumeId': 'f3c600a0-ec73-45bb-b32a-e61b894ed5a0'}}} Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f3c600a0-ec73-45bb-b32a-e61b894ed5a0 is already attached to instances: e3d523a7-6f42-441f-9e01-bf42a5a55e76 Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:47:24.339210 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f3c600a0-ec73-45bb-b32a-e61b894ed5a0 is already attached to instances: e3d523a7-6f42-441f-9e01-bf42a5a55e76 Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:24.340691 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:24.342386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:24.342386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:47:24.342386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:47:24.342386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f3c600a0-ec73-45bb-b32a-e61b894ed5a0 is already attached to instances: e3d523a7-6f42-441f-9e01-bf42a5a55e76 Aug 01 07:47:24.342386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:47:24.342386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-8f54792c-7d1f-4fea-9b2b-138e425031c3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 400 to user: Invalid volume: volume f3c600a0-ec73-45bb-b32a-e61b894ed5a0 is already attached to instances: e3d523a7-6f42-441f-9e01-bf42a5a55e76 {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:47:24.342386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-8f54792c-7d1f-4fea-9b2b-138e425031c3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145972 Aug 01 07:47:24.342386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 544/1069] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:47:24 2022] POST /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments => generated 174 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 07:47:24.402020 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5ff930fe-a7f5-4a80-87d7-797a9b384d3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:24.402612 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5ff930fe-a7f5-4a80-87d7-797a9b384d3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:24.408832 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ff930fe-a7f5-4a80-87d7-797a9b384d3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:24.410065 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ff930fe-a7f5-4a80-87d7-797a9b384d3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:24.410842 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ff930fe-a7f5-4a80-87d7-797a9b384d3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:24.411391 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5ff930fe-a7f5-4a80-87d7-797a9b384d3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:24.489783 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-5ff930fe-a7f5-4a80-87d7-797a9b384d3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lazy-loading 'services' on Instance uuid e3d523a7-6f42-441f-9e01-bf42a5a55e76 {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:47:24.564309 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5ff930fe-a7f5-4a80-87d7-797a9b384d3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments/f3c600a0-ec73-45bb-b32a-e61b894ed5a0" status: 202 len: 0 microversion: 2.1 time: 0.166773 Aug 01 07:47:24.564921 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 526/1070] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:47:24 2022] DELETE /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments/f3c600a0-ec73-45bb-b32a-e61b894ed5a0 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:47:24.573323 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b31f82c9-4344-4be2-9ad6-66358b0ca99e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:24.575534 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b31f82c9-4344-4be2-9ad6-66358b0ca99e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:24.582629 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b31f82c9-4344-4be2-9ad6-66358b0ca99e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:24.583092 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b31f82c9-4344-4be2-9ad6-66358b0ca99e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:24.583945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b31f82c9-4344-4be2-9ad6-66358b0ca99e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:24.584387 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b31f82c9-4344-4be2-9ad6-66358b0ca99e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:24.615708 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b31f82c9-4344-4be2-9ad6-66358b0ca99e tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046325 Aug 01 07:47:24.616267 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 545/1071] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:47:24 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:25.629452 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7f36bd96-5d2a-44bd-b767-cd3bea665b90 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:25.631728 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7f36bd96-5d2a-44bd-b767-cd3bea665b90 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:25.637914 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7f36bd96-5d2a-44bd-b767-cd3bea665b90 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:25.638362 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7f36bd96-5d2a-44bd-b767-cd3bea665b90 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:25.639144 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7f36bd96-5d2a-44bd-b767-cd3bea665b90 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:25.639581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7f36bd96-5d2a-44bd-b767-cd3bea665b90 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:25.667639 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7f36bd96-5d2a-44bd-b767-cd3bea665b90 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043504 Aug 01 07:47:25.668165 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 527/1072] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:47:25 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 07:47:25.728316 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-10b71057-1216-4fd8-b5f4-ce1718614241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:25.728813 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-10b71057-1216-4fd8-b5f4-ce1718614241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:25.735386 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10b71057-1216-4fd8-b5f4-ce1718614241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:25.735836 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10b71057-1216-4fd8-b5f4-ce1718614241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:25.736601 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10b71057-1216-4fd8-b5f4-ce1718614241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:25.737034 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-10b71057-1216-4fd8-b5f4-ce1718614241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:25.762838 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-10b71057-1216-4fd8-b5f4-ce1718614241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:47:25.835824 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-10b71057-1216-4fd8-b5f4-ce1718614241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 204 len: 0 microversion: 2.1 time: 0.111074 Aug 01 07:47:25.836406 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 546/1073] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:47:25 2022] DELETE /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:47:25.844565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-3970ac43-112c-4799-960f-e10f87240e5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:25.845166 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-3970ac43-112c-4799-960f-e10f87240e5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:25.851513 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3970ac43-112c-4799-960f-e10f87240e5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:25.851966 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3970ac43-112c-4799-960f-e10f87240e5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:25.852736 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3970ac43-112c-4799-960f-e10f87240e5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:25.853176 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-3970ac43-112c-4799-960f-e10f87240e5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:25.980652 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-3970ac43-112c-4799-960f-e10f87240e5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:25.988838 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-3970ac43-112c-4799-960f-e10f87240e5d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1680 microversion: 2.1 time: 0.147671 Aug 01 07:47:25.989407 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 528/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:25 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:27.011416 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a09e0ae2-70bd-4a41-b069-0dadb8baa7a6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:27.012103 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a09e0ae2-70bd-4a41-b069-0dadb8baa7a6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:27.021445 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a09e0ae2-70bd-4a41-b069-0dadb8baa7a6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:27.022175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a09e0ae2-70bd-4a41-b069-0dadb8baa7a6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:27.023489 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a09e0ae2-70bd-4a41-b069-0dadb8baa7a6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:27.024218 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a09e0ae2-70bd-4a41-b069-0dadb8baa7a6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:27.166362 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a09e0ae2-70bd-4a41-b069-0dadb8baa7a6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:27.175176 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a09e0ae2-70bd-4a41-b069-0dadb8baa7a6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1680 microversion: 2.1 time: 0.168294 Aug 01 07:47:27.175884 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 547/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:27 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:47:28.197796 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b5f127ac-dc59-4083-8cff-d8035efe3c1d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:28.198418 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b5f127ac-dc59-4083-8cff-d8035efe3c1d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:28.205695 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b5f127ac-dc59-4083-8cff-d8035efe3c1d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:28.206148 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b5f127ac-dc59-4083-8cff-d8035efe3c1d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:28.207522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b5f127ac-dc59-4083-8cff-d8035efe3c1d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:28.207961 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b5f127ac-dc59-4083-8cff-d8035efe3c1d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:28.455709 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b5f127ac-dc59-4083-8cff-d8035efe3c1d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:28.464258 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b5f127ac-dc59-4083-8cff-d8035efe3c1d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 200 len: 1613 microversion: 2.1 time: 0.270298 Aug 01 07:47:28.464837 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 529/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:28 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 1613 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:28.641033 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-b1dc0880-d035-47cc-b50a-46a976a348b7 req-24fe04f9-9484-4d6f-9464-61102636a6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d523a7-6f42-441f-9e01-bf42a5a55e76", "name": "network-vif-deleted", "tag": "d5715865-ad95-499b-a4ce-79063a992ba6"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:28.651596 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-b1dc0880-d035-47cc-b50a-46a976a348b7 req-24fe04f9-9484-4d6f-9464-61102636a6eb service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:28.652364 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-b1dc0880-d035-47cc-b50a-46a976a348b7 req-24fe04f9-9484-4d6f-9464-61102636a6eb service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:28.665148 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-b1dc0880-d035-47cc-b50a-46a976a348b7 req-24fe04f9-9484-4d6f-9464-61102636a6eb service nova] Creating event network-vif-deleted:d5715865-ad95-499b-a4ce-79063a992ba6 for instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 on hv-cinder-73306 Aug 01 07:47:28.670498 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-b1dc0880-d035-47cc-b50a-46a976a348b7 req-24fe04f9-9484-4d6f-9464-61102636a6eb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033865 Aug 01 07:47:28.675126 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 548/1077] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:29.485825 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7f7060fb-2045-4f67-851e-bc6e11dd0f3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:29.486452 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7f7060fb-2045-4f67-851e-bc6e11dd0f3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:29.493704 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7f7060fb-2045-4f67-851e-bc6e11dd0f3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:29.494164 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7f7060fb-2045-4f67-851e-bc6e11dd0f3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:29.495175 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7f7060fb-2045-4f67-851e-bc6e11dd0f3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:29.497289 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7f7060fb-2045-4f67-851e-bc6e11dd0f3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:29.515986 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-7f7060fb-2045-4f67-851e-bc6e11dd0f3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7f7060fb-2045-4f67-851e-bc6e11dd0f3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 HTTP/1.1 Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:47:29.518734 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:47:29.520872 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'e3d523a7-6f42-441f-9e01-bf42a5a55e76'} Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:47:29.521645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:47:29.522935 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:29.524150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-79db40cf-d9d0-49ea-9017-0b94a441404e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:29.524150 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-79db40cf-d9d0-49ea-9017-0b94a441404e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:29.525385 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7f7060fb-2045-4f67-851e-bc6e11dd0f3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:47:29.526247 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7f7060fb-2045-4f67-851e-bc6e11dd0f3c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 404 len: 111 microversion: 2.1 time: 0.044682 Aug 01 07:47:29.526972 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 530/1078] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:29 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:47:29.531678 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-3ac7e223-ee3e-4ef3-b3f0-88c9d71411cc req-243cc0af-71e7-4fd3-82e8-f2e65a0b4992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78805be6-c120-4b51-b0ec-5584213faba9", "tag": "420c6c2c-7f14-4b05-8acd-b68203798cf5"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:29.532344 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79db40cf-d9d0-49ea-9017-0b94a441404e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:29.532871 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79db40cf-d9d0-49ea-9017-0b94a441404e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:29.534438 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79db40cf-d9d0-49ea-9017-0b94a441404e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:29.535695 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-79db40cf-d9d0-49ea-9017-0b94a441404e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:29.545185 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-3ac7e223-ee3e-4ef3-b3f0-88c9d71411cc req-243cc0af-71e7-4fd3-82e8-f2e65a0b4992 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:29.545644 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-3ac7e223-ee3e-4ef3-b3f0-88c9d71411cc req-243cc0af-71e7-4fd3-82e8-f2e65a0b4992 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:29.565146 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-3ac7e223-ee3e-4ef3-b3f0-88c9d71411cc req-243cc0af-71e7-4fd3-82e8-f2e65a0b4992 service nova] Creating event network-changed:420c6c2c-7f14-4b05-8acd-b68203798cf5 for instance 78805be6-c120-4b51-b0ec-5584213faba9 on hv-cinder-73306 Aug 01 07:47:29.572074 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-3ac7e223-ee3e-4ef3-b3f0-88c9d71411cc req-243cc0af-71e7-4fd3-82e8-f2e65a0b4992 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043662 Aug 01 07:47:29.572673 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 531/1079] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:29.578540 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-cd5728cd-7ff4-4cd5-9974-b53583dbc082 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '.version_select at 0x7fd018ac93a0>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:29.580802 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-79db40cf-d9d0-49ea-9017-0b94a441404e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:47:29.607185 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-cd5728cd-7ff4-4cd5-9974-b53583dbc082 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-343838746" status: 202 len: 0 microversion: 2.1 time: 0.032597 Aug 01 07:47:29.608346 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 532/1080] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Aug 1 07:47:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-343838746 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:47:29.728465 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-79db40cf-d9d0-49ea-9017-0b94a441404e tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "DELETE /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 204 len: 0 microversion: 2.1 time: 0.212017 Aug 01 07:47:29.732223 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 549/1081] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:47:29 2022] DELETE /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 07:47:29.738204 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-da573811-a08e-4140-86b4-9157ece7bc62 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:29.739156 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-da573811-a08e-4140-86b4-9157ece7bc62 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:29.749924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da573811-a08e-4140-86b4-9157ece7bc62 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:29.750388 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da573811-a08e-4140-86b4-9157ece7bc62 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:29.751211 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da573811-a08e-4140-86b4-9157ece7bc62 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:29.751662 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-da573811-a08e-4140-86b4-9157ece7bc62 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:29.945149 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-da573811-a08e-4140-86b4-9157ece7bc62 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:29.954683 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-da573811-a08e-4140-86b4-9157ece7bc62 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1578 microversion: 2.1 time: 0.221124 Aug 01 07:47:29.956056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 533/1082] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:29 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:30.335891 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3c1f3262-99b5-4d66-ba52-7b0b1c19293c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: .version_select at 0x7fd018bf5310>, body: {"keypair": {"name": "tempest-keypair-1138812686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRRgOZmxhHca4IwfRQamnVFzhkVrZE+TEHY4ZFKaTkbLxnYayBamG9FAU7SD0J0aArsFdTpDLO2o3ZlDMf7zK+v5v3d9HfQ5+ZWfL6OJ0w+MUtRH1A9pWevOYGhguFgwQ=="}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:30.351598 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-3c1f3262-99b5-4d66-ba52-7b0b1c19293c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for project 49e0013064fc495285dad557b0beef7d. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:47:30.355574 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.quota [None req-3c1f3262-99b5-4d66-ba52-7b0b1c19293c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for user 1ba46a929ed54c51a33662367289eee5 and project 49e0013064fc495285dad557b0beef7d. Resources: {'key_pairs'} {{(pid=124279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:47:30.378508 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3c1f3262-99b5-4d66-ba52-7b0b1c19293c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047836 Aug 01 07:47:30.384305 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 550/1083] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 1 07:47:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:47:30.976522 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7177434b-45d4-411e-8d5f-8bf6582f8cd4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:30.977141 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7177434b-45d4-411e-8d5f-8bf6582f8cd4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:30.984249 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7177434b-45d4-411e-8d5f-8bf6582f8cd4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:30.984710 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7177434b-45d4-411e-8d5f-8bf6582f8cd4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:30.985525 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7177434b-45d4-411e-8d5f-8bf6582f8cd4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:30.985976 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7177434b-45d4-411e-8d5f-8bf6582f8cd4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:31.284696 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-7177434b-45d4-411e-8d5f-8bf6582f8cd4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:31.292465 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7177434b-45d4-411e-8d5f-8bf6582f8cd4 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1578 microversion: 2.1 time: 0.320103 Aug 01 07:47:31.293134 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 534/1084] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:30 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1578 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:47:32.314236 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-321a74e9-bed5-42d2-92d7-1bbce980efe0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:32.315074 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-321a74e9-bed5-42d2-92d7-1bbce980efe0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:32.323049 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-321a74e9-bed5-42d2-92d7-1bbce980efe0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:32.323516 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-321a74e9-bed5-42d2-92d7-1bbce980efe0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:32.324299 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-321a74e9-bed5-42d2-92d7-1bbce980efe0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:32.324734 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-321a74e9-bed5-42d2-92d7-1bbce980efe0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:32.361131 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [req-78a61b16-7864-437d-9c1e-9224c3312807 req-cfc8b90a-ffff-4f2e-911f-fa65f808d34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78805be6-c120-4b51-b0ec-5584213faba9", "name": "network-vif-deleted", "tag": "420c6c2c-7f14-4b05-8acd-b68203798cf5"}]} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:32.383227 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-78a61b16-7864-437d-9c1e-9224c3312807 req-cfc8b90a-ffff-4f2e-911f-fa65f808d34d service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:32.383684 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [req-78a61b16-7864-437d-9c1e-9224c3312807 req-cfc8b90a-ffff-4f2e-911f-fa65f808d34d service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:32.404574 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.compute.server_external_events [req-78a61b16-7864-437d-9c1e-9224c3312807 req-cfc8b90a-ffff-4f2e-911f-fa65f808d34d service nova] Creating event network-vif-deleted:420c6c2c-7f14-4b05-8acd-b68203798cf5 for instance 78805be6-c120-4b51-b0ec-5584213faba9 on hv-cinder-73306 Aug 01 07:47:32.411450 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [req-78a61b16-7864-437d-9c1e-9224c3312807 req-cfc8b90a-ffff-4f2e-911f-fa65f808d34d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061384 Aug 01 07:47:32.412095 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 535/1085] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:32.419596 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-172146832", "imageRef": "ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d0500b7-ad41-4ce8-9297-aa02b3bcbfff"}], "security_groups": [{"name": "tempest-securitygroup--255148747"}], "key_name": "tempest-keypair-1138812686", "user_data": "}} {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:32.432194 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-321a74e9-bed5-42d2-92d7-1bbce980efe0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:32.440160 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-321a74e9-bed5-42d2-92d7-1bbce980efe0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 200 len: 1391 microversion: 2.1 time: 0.130271 Aug 01 07:47:32.440731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 551/1086] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:32 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 1391 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:32.526402 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.network.neutron [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] validate_networks() for [('4d0500b7-ad41-4ce8-9297-aa02b3bcbfff', None, None, None, None, None)] {{(pid=124280) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 07:47:32.926266 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Flavor limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 07:47:32.926688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Image limits 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 07:47:32.927188 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Flavor pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 07:47:32.927594 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Image pref 0:0:0 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 07:47:32.928003 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.virt.hardware [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 07:47:32.936901 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:32.937333 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:32.938123 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:32.938566 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:32.957316 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for project 49e0013064fc495285dad557b0beef7d. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 07:47:32.961311 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.quota [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Getting quotas for user 1ba46a929ed54c51a33662367289eee5 and project 49e0013064fc495285dad557b0beef7d. Resources: {'cores', 'instances', 'ram'} {{(pid=124280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 07:47:32.973136 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Going to run 1 instances... {{(pid=124280) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 07:47:32.975570 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddfff51f-aaf5-4a9b-9cb3-1cb45ab0b50d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 07:47:33.022455 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b36ca79f-ede7-4682-aae4-8a5cf134d6bc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.608299 Aug 01 07:47:33.023129 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 536/1087] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 1 07:47:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 07:47:33.033862 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-91518122-e556-49c2-8589-015de2b9816c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:33.034471 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-91518122-e556-49c2-8589-015de2b9816c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:33.109838 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-91518122-e556-49c2-8589-015de2b9816c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:33.121651 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-91518122-e556-49c2-8589-015de2b9816c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1241 microversion: 2.1 time: 0.091606 Aug 01 07:47:33.122716 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 552/1088] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:33 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:33.463170 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b42784d9-b202-4f8e-8219-38a8144132d0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:33.463762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b42784d9-b202-4f8e-8219-38a8144132d0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 78805be6-c120-4b51-b0ec-5584213faba9] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:33.470745 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b42784d9-b202-4f8e-8219-38a8144132d0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:33.471242 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b42784d9-b202-4f8e-8219-38a8144132d0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:33.471993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b42784d9-b202-4f8e-8219-38a8144132d0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:33.473089 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b42784d9-b202-4f8e-8219-38a8144132d0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:33.485985 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-b42784d9-b202-4f8e-8219-38a8144132d0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] HTTP exception thrown: Instance 78805be6-c120-4b51-b0ec-5584213faba9 could not be found. Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b42784d9-b202-4f8e-8219-38a8144132d0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Request method failure captured: Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 HTTP/1.1 Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54M9aI3UB5p6FHeWVQuxgEmtCPY73hp3AUUoUvvcdPrKSzbuRzDMFDwB0iK3UlSca1Nhlp4-V5lWkZlvz0a0Lds2WOMm8d9BJbwLSnQAEIiYTqP1DWc2GOPzvQPYuaGwMs57fBwM0yuRyQi6t0IycnSqslUbEFuk6v_2AGHDJVfQXdE Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 810069989cfb42799139be8ec2423288 Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:47:33.487682 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/810069989cfb42799139be8ec2423288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/810069989cfb42799139be8ec2423288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/810069989cfb42799139be8ec2423288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_810069989cfb42799139be8ec2423288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 810069989cfb42799139be8ec2423288 Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-TestVolumeBootPattern-745031385-project Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 890be2e19b43473caa79b2dc889f8436 Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-TestVolumeBootPattern-745031385-project Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 78805be6-c120-4b51-b0ec-5584213faba9 could not be found. Aug 01 07:47:33.489672 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '78805be6-c120-4b51-b0ec-5584213faba9'} Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78805be6-c120-4b51-b0ec-5584213faba9 could not be found. Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:47:33.494271 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78805be6-c120-4b51-b0ec-5584213faba9 could not be found. Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78805be6-c120-4b51-b0ec-5584213faba9 could not be found. Aug 01 07:47:33.497611 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:33.500180 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b42784d9-b202-4f8e-8219-38a8144132d0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Returning 404 to user: Instance 78805be6-c120-4b51-b0ec-5584213faba9 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:47:33.500180 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b42784d9-b202-4f8e-8219-38a8144132d0 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9" status: 404 len: 111 microversion: 2.1 time: 0.030618 Aug 01 07:47:33.500180 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 537/1089] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:33 2022] GET /compute/v2.1/servers/78805be6-c120-4b51-b0ec-5584213faba9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:47:34.142731 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-6bba1bc6-6505-4207-b48d-7c2e66c4e5fd tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:34.143376 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-6bba1bc6-6505-4207-b48d-7c2e66c4e5fd tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:34.151565 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6bba1bc6-6505-4207-b48d-7c2e66c4e5fd tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:34.152231 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6bba1bc6-6505-4207-b48d-7c2e66c4e5fd tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:34.153177 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6bba1bc6-6505-4207-b48d-7c2e66c4e5fd tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:34.153918 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-6bba1bc6-6505-4207-b48d-7c2e66c4e5fd tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:34.221046 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-6bba1bc6-6505-4207-b48d-7c2e66c4e5fd tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:34.229187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-6bba1bc6-6505-4207-b48d-7c2e66c4e5fd tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1299 microversion: 2.1 time: 0.090347 Aug 01 07:47:34.229762 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 553/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:34 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:47:35.250073 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ec3513d0-03d4-4cbf-b8bd-9cb685ed2f03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:35.250825 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ec3513d0-03d4-4cbf-b8bd-9cb685ed2f03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:35.258091 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ec3513d0-03d4-4cbf-b8bd-9cb685ed2f03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:35.258548 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ec3513d0-03d4-4cbf-b8bd-9cb685ed2f03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:35.259346 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ec3513d0-03d4-4cbf-b8bd-9cb685ed2f03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:35.259789 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ec3513d0-03d4-4cbf-b8bd-9cb685ed2f03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:35.300132 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-1534ddd5-fba7-4268-9b42-169a90db09fa req-e7d8e84f-a5dc-4f31-8706-ec0a45434b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b88d866-9362-41dd-9880-585e3dacc495", "tag": "433ad631-ebba-4854-909e-a4e5aab5bed1"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:35.314047 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-1534ddd5-fba7-4268-9b42-169a90db09fa req-e7d8e84f-a5dc-4f31-8706-ec0a45434b8a service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:35.314775 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-1534ddd5-fba7-4268-9b42-169a90db09fa req-e7d8e84f-a5dc-4f31-8706-ec0a45434b8a service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:35.328353 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-1534ddd5-fba7-4268-9b42-169a90db09fa req-e7d8e84f-a5dc-4f31-8706-ec0a45434b8a service nova] Creating event network-changed:433ad631-ebba-4854-909e-a4e5aab5bed1 for instance 4b88d866-9362-41dd-9880-585e3dacc495 on hv-cinder-73306 Aug 01 07:47:35.334463 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-1534ddd5-fba7-4268-9b42-169a90db09fa req-e7d8e84f-a5dc-4f31-8706-ec0a45434b8a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039030 Aug 01 07:47:35.335090 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 554/1091] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:35.528766 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-ec3513d0-03d4-4cbf-b8bd-9cb685ed2f03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:35.536546 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ec3513d0-03d4-4cbf-b8bd-9cb685ed2f03 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1366 microversion: 2.1 time: 0.290667 Aug 01 07:47:35.537112 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 538/1092] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:35 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:36.557635 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-5bf2b99e-9fe6-48a9-9412-d13ee9e6d0e9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:36.558244 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-5bf2b99e-9fe6-48a9-9412-d13ee9e6d0e9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:36.565026 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf2b99e-9fe6-48a9-9412-d13ee9e6d0e9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:36.565478 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf2b99e-9fe6-48a9-9412-d13ee9e6d0e9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:36.566335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf2b99e-9fe6-48a9-9412-d13ee9e6d0e9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:36.566775 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-5bf2b99e-9fe6-48a9-9412-d13ee9e6d0e9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:36.763496 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-5bf2b99e-9fe6-48a9-9412-d13ee9e6d0e9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:36.771745 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-5bf2b99e-9fe6-48a9-9412-d13ee9e6d0e9 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1366 microversion: 2.1 time: 0.218296 Aug 01 07:47:36.772705 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 555/1093] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:36 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:36.866930 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-42933863-b951-408d-9b1a-498735eaf4d5 req-d73e2615-93a6-48c5-b440-c9a05f881b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ea6b56-5481-4605-b6df-ad8b3d7a1eb2", "tag": "f430032e-c17e-4c53-8b5f-6ac11189c17a"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:36.867303 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-ad38d74e-9172-4fee-a4a3-fd291101de5c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:36.867916 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ad38d74e-9172-4fee-a4a3-fd291101de5c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:36.875465 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad38d74e-9172-4fee-a4a3-fd291101de5c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:36.876010 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad38d74e-9172-4fee-a4a3-fd291101de5c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:36.876747 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-42933863-b951-408d-9b1a-498735eaf4d5 req-d73e2615-93a6-48c5-b440-c9a05f881b01 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:36.876885 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad38d74e-9172-4fee-a4a3-fd291101de5c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:36.877470 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-ad38d74e-9172-4fee-a4a3-fd291101de5c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:36.878099 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-42933863-b951-408d-9b1a-498735eaf4d5 req-d73e2615-93a6-48c5-b440-c9a05f881b01 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:36.895536 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-42933863-b951-408d-9b1a-498735eaf4d5 req-d73e2615-93a6-48c5-b440-c9a05f881b01 service nova] Creating event network-changed:f430032e-c17e-4c53-8b5f-6ac11189c17a for instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 on hv-cinder-73306 Aug 01 07:47:36.901880 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-42933863-b951-408d-9b1a-498735eaf4d5 req-d73e2615-93a6-48c5-b440-c9a05f881b01 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039630 Aug 01 07:47:36.903191 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 556/1094] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:36.911834 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-ad38d74e-9172-4fee-a4a3-fd291101de5c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Going to try to terminate instance {{(pid=124280) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:47:37.005148 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-ad38d74e-9172-4fee-a4a3-fd291101de5c tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "DELETE /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 204 len: 0 microversion: 2.1 time: 0.144709 Aug 01 07:47:37.006193 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 539/1095] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:47:36 2022] DELETE /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:47:37.015342 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-3cf1c428-c4af-4dbc-b02c-9ae802c47877 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:37.016337 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-3cf1c428-c4af-4dbc-b02c-9ae802c47877 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:37.024025 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3cf1c428-c4af-4dbc-b02c-9ae802c47877 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:37.024472 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3cf1c428-c4af-4dbc-b02c-9ae802c47877 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:37.025428 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3cf1c428-c4af-4dbc-b02c-9ae802c47877 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:37.025864 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-3cf1c428-c4af-4dbc-b02c-9ae802c47877 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:37.170904 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-3cf1c428-c4af-4dbc-b02c-9ae802c47877 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:37.180427 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-3cf1c428-c4af-4dbc-b02c-9ae802c47877 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1577 microversion: 2.1 time: 0.169491 Aug 01 07:47:37.181018 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 557/1096] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:37 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:47:37.793458 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-eaef9087-3cd9-4ff0-95f4-2b10b76da3b1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:37.794493 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-eaef9087-3cd9-4ff0-95f4-2b10b76da3b1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:37.801312 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eaef9087-3cd9-4ff0-95f4-2b10b76da3b1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:37.801762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eaef9087-3cd9-4ff0-95f4-2b10b76da3b1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:37.802535 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eaef9087-3cd9-4ff0-95f4-2b10b76da3b1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:37.802972 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-eaef9087-3cd9-4ff0-95f4-2b10b76da3b1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:37.934794 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-eaef9087-3cd9-4ff0-95f4-2b10b76da3b1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:37.942706 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-eaef9087-3cd9-4ff0-95f4-2b10b76da3b1 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1366 microversion: 2.1 time: 0.153521 Aug 01 07:47:37.943305 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 540/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:37 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:38.203176 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9ddef897-3b7c-47aa-b70f-e3e2cfe7dc35 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:38.204005 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-9ddef897-3b7c-47aa-b70f-e3e2cfe7dc35 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:38.212204 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9ddef897-3b7c-47aa-b70f-e3e2cfe7dc35 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:38.212755 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9ddef897-3b7c-47aa-b70f-e3e2cfe7dc35 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:38.213635 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9ddef897-3b7c-47aa-b70f-e3e2cfe7dc35 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:38.214075 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-9ddef897-3b7c-47aa-b70f-e3e2cfe7dc35 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:38.354063 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-9ddef897-3b7c-47aa-b70f-e3e2cfe7dc35 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:38.361783 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9ddef897-3b7c-47aa-b70f-e3e2cfe7dc35 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1577 microversion: 2.1 time: 0.162972 Aug 01 07:47:38.362217 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 558/1098] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:38 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:38.968157 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b19da453-057c-4a8d-892b-7aca66905452 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:38.969358 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b19da453-057c-4a8d-892b-7aca66905452 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:38.977953 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b19da453-057c-4a8d-892b-7aca66905452 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:38.978660 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b19da453-057c-4a8d-892b-7aca66905452 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:38.979484 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b19da453-057c-4a8d-892b-7aca66905452 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:38.979924 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b19da453-057c-4a8d-892b-7aca66905452 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:39.177382 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b19da453-057c-4a8d-892b-7aca66905452 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:39.185019 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b19da453-057c-4a8d-892b-7aca66905452 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1366 microversion: 2.1 time: 0.225411 Aug 01 07:47:39.186010 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 541/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:38 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:39.350454 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-99d21f97-3244-4bbf-ba25-a847cb4f8e60 req-014ac53f-cd01-408d-ad31-5122f2142284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ea6b56-5481-4605-b6df-ad8b3d7a1eb2", "name": "network-vif-deleted", "tag": "f430032e-c17e-4c53-8b5f-6ac11189c17a"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:39.366440 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-99d21f97-3244-4bbf-ba25-a847cb4f8e60 req-014ac53f-cd01-408d-ad31-5122f2142284 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:39.366882 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-99d21f97-3244-4bbf-ba25-a847cb4f8e60 req-014ac53f-cd01-408d-ad31-5122f2142284 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:39.383514 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-553eb075-0677-407a-9d4f-1827fa26c669 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:39.384403 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-553eb075-0677-407a-9d4f-1827fa26c669 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:39.391723 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-99d21f97-3244-4bbf-ba25-a847cb4f8e60 req-014ac53f-cd01-408d-ad31-5122f2142284 service nova] Creating event network-vif-deleted:f430032e-c17e-4c53-8b5f-6ac11189c17a for instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 on hv-cinder-73306 Aug 01 07:47:39.398894 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-553eb075-0677-407a-9d4f-1827fa26c669 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:39.399377 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-553eb075-0677-407a-9d4f-1827fa26c669 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:39.400156 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-553eb075-0677-407a-9d4f-1827fa26c669 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:39.400595 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-553eb075-0677-407a-9d4f-1827fa26c669 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:39.404981 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:47:39.408027 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-99d21f97-3244-4bbf-ba25-a847cb4f8e60 req-014ac53f-cd01-408d-ad31-5122f2142284 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067473 Aug 01 07:47:39.408900 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 559/1100] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:39.474551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-553eb075-0677-407a-9d4f-1827fa26c669 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890be2e19b43473caa79b2dc889f8436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810069989cfb42799139be8ec2423288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:39.482127 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-553eb075-0677-407a-9d4f-1827fa26c669 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 200 len: 1225 microversion: 2.1 time: 0.102462 Aug 01 07:47:39.482684 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 542/1101] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:39 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:47:40.207444 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1c1ad62e-336d-4370-9532-776952300ff4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:40.208177 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1c1ad62e-336d-4370-9532-776952300ff4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:40.214575 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c1ad62e-336d-4370-9532-776952300ff4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:40.215029 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c1ad62e-336d-4370-9532-776952300ff4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:40.215837 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c1ad62e-336d-4370-9532-776952300ff4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:40.216278 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1c1ad62e-336d-4370-9532-776952300ff4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:40.343149 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-1c1ad62e-336d-4370-9532-776952300ff4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:40.350413 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1c1ad62e-336d-4370-9532-776952300ff4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1366 microversion: 2.1 time: 0.147401 Aug 01 07:47:40.350964 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 560/1102] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:40 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:40.503707 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-887f563b-90ad-4d5e-a7ee-9c5fd5fda05f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:40.504221 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-887f563b-90ad-4d5e-a7ee-9c5fd5fda05f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:40.510708 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-887f563b-90ad-4d5e-a7ee-9c5fd5fda05f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:40.511197 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-887f563b-90ad-4d5e-a7ee-9c5fd5fda05f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:40.512051 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-887f563b-90ad-4d5e-a7ee-9c5fd5fda05f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:40.512494 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-887f563b-90ad-4d5e-a7ee-9c5fd5fda05f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:40.525448 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-887f563b-90ad-4d5e-a7ee-9c5fd5fda05f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] HTTP exception thrown: Instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 could not be found. Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-887f563b-90ad-4d5e-a7ee-9c5fd5fda05f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Request method failure captured: Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 HTTP/1.1 Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54M9aI3UB5p6FHeWVQuxgEmtCPY73hp3AUUoUvvcdPrKSzbuRzDMFDwB0iK3UlSca1Nhlp4-V5lWkZlvz0a0Lds2WOMm8d9BJbwLSnQAEIiYTqP1DWc2GOPzvQPYuaGwMs57fBwM0yuRyQi6t0IycnSqslUbEFuk6v_2AGHDJVfQXdE Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 810069989cfb42799139be8ec2423288 Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:47:40.527056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/810069989cfb42799139be8ec2423288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/810069989cfb42799139be8ec2423288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/810069989cfb42799139be8ec2423288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_810069989cfb42799139be8ec2423288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 810069989cfb42799139be8ec2423288 Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-TestVolumeBootPattern-745031385-project Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 890be2e19b43473caa79b2dc889f8436 Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-TestVolumeBootPattern-745031385-project Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 could not be found. Aug 01 07:47:40.528806 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '67ea6b56-5481-4605-b6df-ad8b3d7a1eb2'} Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 could not be found. Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:47:40.529913 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 could not be found. Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 could not be found. Aug 01 07:47:40.531557 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:40.532990 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-887f563b-90ad-4d5e-a7ee-9c5fd5fda05f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Returning 404 to user: Instance 67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:47:40.532990 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-887f563b-90ad-4d5e-a7ee-9c5fd5fda05f tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2" status: 404 len: 111 microversion: 2.1 time: 0.028891 Aug 01 07:47:40.532990 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 543/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:40 2022] GET /compute/v2.1/servers/67ea6b56-5481-4605-b6df-ad8b3d7a1eb2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:47:40.967148 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e52d03c3-92e8-4ea7-bcb2-690e61761eff tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:40.967716 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-e52d03c3-92e8-4ea7-bcb2-690e61761eff tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:40.974765 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e52d03c3-92e8-4ea7-bcb2-690e61761eff tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:40.975335 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e52d03c3-92e8-4ea7-bcb2-690e61761eff tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:40.976203 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e52d03c3-92e8-4ea7-bcb2-690e61761eff tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:40.976699 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-e52d03c3-92e8-4ea7-bcb2-690e61761eff tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:40.981187 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:47:40.992631 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-e52d03c3-92e8-4ea7-bcb2-690e61761eff tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] HTTP exception thrown: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e52d03c3-92e8-4ea7-bcb2-690e61761eff tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Request method failure captured: Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: DELETE /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb HTTP/1.1 Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54M9aI3UB5p6FHeWVQuxgEmtCPY73hp3AUUoUvvcdPrKSzbuRzDMFDwB0iK3UlSca1Nhlp4-V5lWkZlvz0a0Lds2WOMm8d9BJbwLSnQAEIiYTqP1DWc2GOPzvQPYuaGwMs57fBwM0yuRyQi6t0IycnSqslUbEFuk6v_2AGHDJVfQXdE Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 810069989cfb42799139be8ec2423288 Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:47:40.994662 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/810069989cfb42799139be8ec2423288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/810069989cfb42799139be8ec2423288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/810069989cfb42799139be8ec2423288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_810069989cfb42799139be8ec2423288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 810069989cfb42799139be8ec2423288 Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-TestVolumeBootPattern-745031385-project Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 890be2e19b43473caa79b2dc889f8436 Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-TestVolumeBootPattern-745031385-project Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:47:40.996378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': 'b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb'} Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:47:40.997619 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:47:40.999175 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:47:41.000721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-e52d03c3-92e8-4ea7-bcb2-690e61761eff tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Returning 404 to user: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:47:41.000721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-e52d03c3-92e8-4ea7-bcb2-690e61761eff tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 404 len: 111 microversion: 2.1 time: 0.033726 Aug 01 07:47:41.000721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 561/1104] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:47:40 2022] DELETE /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 07:47:41.010645 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-db37e3e5-7604-4549-b626-4eaa1a4a7236 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:41.011392 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-db37e3e5-7604-4549-b626-4eaa1a4a7236 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] [instance: b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:41.017573 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-db37e3e5-7604-4549-b626-4eaa1a4a7236 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:41.018021 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-db37e3e5-7604-4549-b626-4eaa1a4a7236 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:41.019403 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-db37e3e5-7604-4549-b626-4eaa1a4a7236 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:41.019851 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-db37e3e5-7604-4549-b626-4eaa1a4a7236 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:41.033520 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-db37e3e5-7604-4549-b626-4eaa1a4a7236 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] HTTP exception thrown: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-db37e3e5-7604-4549-b626-4eaa1a4a7236 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Request method failure captured: Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb HTTP/1.1 Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54M9aI3UB5p6FHeWVQuxgEmtCPY73hp3AUUoUvvcdPrKSzbuRzDMFDwB0iK3UlSca1Nhlp4-V5lWkZlvz0a0Lds2WOMm8d9BJbwLSnQAEIiYTqP1DWc2GOPzvQPYuaGwMs57fBwM0yuRyQi6t0IycnSqslUbEFuk6v_2AGHDJVfQXdE Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 810069989cfb42799139be8ec2423288 Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:47:41.035956 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/810069989cfb42799139be8ec2423288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/810069989cfb42799139be8ec2423288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/810069989cfb42799139be8ec2423288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_810069989cfb42799139be8ec2423288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 810069989cfb42799139be8ec2423288 Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-TestVolumeBootPattern-745031385 Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-TestVolumeBootPattern-745031385-project Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 890be2e19b43473caa79b2dc889f8436 Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-TestVolumeBootPattern-745031385-project Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:47:41.037630 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb'} Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:47:41.038473 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. Aug 01 07:47:41.039827 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:47:41.040974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-db37e3e5-7604-4549-b626-4eaa1a4a7236 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Returning 404 to user: Instance b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:47:41.040974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-db37e3e5-7604-4549-b626-4eaa1a4a7236 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb" status: 404 len: 111 microversion: 2.1 time: 0.030822 Aug 01 07:47:41.040974 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 544/1105] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:41 2022] GET /compute/v2.1/servers/b0c436da-bdcb-43c2-a7b2-dc4433f9cbdb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:47:41.047778 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-a37bc8cd-aef3-4386-bf8b-a4a4ef84e19e req-f5e37893-abcc-4116-8a8f-74462d5b35ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88d866-9362-41dd-9880-585e3dacc495", "name": "network-vif-plugged", "status": "completed", "tag": "433ad631-ebba-4854-909e-a4e5aab5bed1"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:41.060567 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-a37bc8cd-aef3-4386-bf8b-a4a4ef84e19e req-f5e37893-abcc-4116-8a8f-74462d5b35ba service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:41.061034 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-a37bc8cd-aef3-4386-bf8b-a4a4ef84e19e req-f5e37893-abcc-4116-8a8f-74462d5b35ba service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:41.072815 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-a37bc8cd-aef3-4386-bf8b-a4a4ef84e19e req-f5e37893-abcc-4116-8a8f-74462d5b35ba service nova] Creating event network-vif-plugged:433ad631-ebba-4854-909e-a4e5aab5bed1 for instance 4b88d866-9362-41dd-9880-585e3dacc495 on hv-cinder-73306 Aug 01 07:47:41.077906 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-a37bc8cd-aef3-4386-bf8b-a4a4ef84e19e req-f5e37893-abcc-4116-8a8f-74462d5b35ba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034862 Aug 01 07:47:41.078492 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 562/1106] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:41.371198 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-e25cdb5e-b260-45f1-a9a1-f20a829cdeb4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:41.372059 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-e25cdb5e-b260-45f1-a9a1-f20a829cdeb4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:41.378365 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e25cdb5e-b260-45f1-a9a1-f20a829cdeb4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:41.378765 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e25cdb5e-b260-45f1-a9a1-f20a829cdeb4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:41.379551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e25cdb5e-b260-45f1-a9a1-f20a829cdeb4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:41.380016 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-e25cdb5e-b260-45f1-a9a1-f20a829cdeb4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:41.535438 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-e25cdb5e-b260-45f1-a9a1-f20a829cdeb4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:41.542821 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-e25cdb5e-b260-45f1-a9a1-f20a829cdeb4 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1366 microversion: 2.1 time: 0.175589 Aug 01 07:47:41.543419 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 545/1107] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:41 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:42.350655 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-9ec47bfc-7042-4dc7-a4f2-bba1dfb5ead6 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] Calling method '.version_select at 0x7fd018a51820>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:42.372435 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-9ec47bfc-7042-4dc7-a4f2-bba1dfb5ead6 tempest-TestVolumeBootPattern-745031385 tempest-TestVolumeBootPattern-745031385-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1723413518" status: 202 len: 0 microversion: 2.1 time: 0.025662 Aug 01 07:47:42.373099 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 563/1108] 10.222.0.40 () {58 vars in 1263 bytes} [Mon Aug 1 07:47:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1723413518 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:47:42.564141 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-08e8d87b-6857-40f3-bbdc-27d6bb9ddd69 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:42.564779 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-08e8d87b-6857-40f3-bbdc-27d6bb9ddd69 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:42.571984 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08e8d87b-6857-40f3-bbdc-27d6bb9ddd69 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:42.572434 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08e8d87b-6857-40f3-bbdc-27d6bb9ddd69 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:42.573202 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08e8d87b-6857-40f3-bbdc-27d6bb9ddd69 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:42.573648 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-08e8d87b-6857-40f3-bbdc-27d6bb9ddd69 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:42.704526 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-08e8d87b-6857-40f3-bbdc-27d6bb9ddd69 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:42.712156 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-08e8d87b-6857-40f3-bbdc-27d6bb9ddd69 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1366 microversion: 2.1 time: 0.151945 Aug 01 07:47:42.712812 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 546/1109] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:42 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:43.730801 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell0:SELECT=6 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:47:43.735314 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a4087362-853d-4a80-9b5c-ad71e9c4b814 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:43.736028 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-a4087362-853d-4a80-9b5c-ad71e9c4b814 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:43.743607 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a4087362-853d-4a80-9b5c-ad71e9c4b814 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:43.744173 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a4087362-853d-4a80-9b5c-ad71e9c4b814 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:43.744975 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a4087362-853d-4a80-9b5c-ad71e9c4b814 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:43.745418 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-a4087362-853d-4a80-9b5c-ad71e9c4b814 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:44.162689 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-a4087362-853d-4a80-9b5c-ad71e9c4b814 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:47:44.170721 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a4087362-853d-4a80-9b5c-ad71e9c4b814 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1557 microversion: 2.1 time: 0.440744 Aug 01 07:47:44.171970 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 564/1110] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:47:43 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1557 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:47:44.191545 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-540bdc3b-9182-4c86-adc8-218912a35112 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:47:44.192109 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-540bdc3b-9182-4c86-adc8-218912a35112 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:47:44.193929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=2 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:47:44.194684 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell0:SELECT=6 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:47:44.201623 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-540bdc3b-9182-4c86-adc8-218912a35112 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:44.202085 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-540bdc3b-9182-4c86-adc8-218912a35112 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:44.202871 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-540bdc3b-9182-4c86-adc8-218912a35112 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:44.203346 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-540bdc3b-9182-4c86-adc8-218912a35112 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:44.293759 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-540bdc3b-9182-4c86-adc8-218912a35112 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106574 Aug 01 07:47:44.294629 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 547/1111] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 1 07:47:44 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:47:45.373468 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-c5a2dfe2-e491-480a-80ff-4f8034ea261d req-56c6284e-8416-47af-8bb2-5ef1e56161a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b88d866-9362-41dd-9880-585e3dacc495", "tag": "433ad631-ebba-4854-909e-a4e5aab5bed1"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:47:45.379764 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:47:45.392726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-c5a2dfe2-e491-480a-80ff-4f8034ea261d req-56c6284e-8416-47af-8bb2-5ef1e56161a1 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:47:45.392726 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-c5a2dfe2-e491-480a-80ff-4f8034ea261d req-56c6284e-8416-47af-8bb2-5ef1e56161a1 service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:47:45.405440 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-c5a2dfe2-e491-480a-80ff-4f8034ea261d req-56c6284e-8416-47af-8bb2-5ef1e56161a1 service nova] Creating event network-changed:433ad631-ebba-4854-909e-a4e5aab5bed1 for instance 4b88d866-9362-41dd-9880-585e3dacc495 on hv-cinder-73306 Aug 01 07:47:45.412885 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-c5a2dfe2-e491-480a-80ff-4f8034ea261d req-56c6284e-8416-47af-8bb2-5ef1e56161a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043319 Aug 01 07:47:45.416921 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 565/1112] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:21.508396 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:48:21.509404 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG dbcounter [-] [124280] Writing DB stats nova_cell1:SELECT=24 {{(pid=124280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:48:21.513943 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-6495b8a0-d89c-4bf9-8f47-6da348d7effc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:21.514435 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-6495b8a0-d89c-4bf9-8f47-6da348d7effc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:21.521896 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6495b8a0-d89c-4bf9-8f47-6da348d7effc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:21.522352 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6495b8a0-d89c-4bf9-8f47-6da348d7effc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:21.523147 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6495b8a0-d89c-4bf9-8f47-6da348d7effc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:21.524649 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-6495b8a0-d89c-4bf9-8f47-6da348d7effc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:21.556189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-6495b8a0-d89c-4bf9-8f47-6da348d7effc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/ips" status: 200 len: 151 microversion: 2.1 time: 0.049848 Aug 01 07:48:21.556779 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 548/1113] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 1 07:48:21 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:22.877091 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG dbcounter [-] [124279] Writing DB stats nova_cell1:SELECT=10 {{(pid=124279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:48:22.882014 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-90e4052c-c31c-4604-b185-b5612eca170c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aa0f305-7373-4fe2-8929-a6f897a158be"}} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:48:22.885004 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-90e4052c-c31c-4604-b185-b5612eca170c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:22.894378 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-90e4052c-c31c-4604-b185-b5612eca170c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:22.894834 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-90e4052c-c31c-4604-b185-b5612eca170c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:22.895631 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-90e4052c-c31c-4604-b185-b5612eca170c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:22.896081 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-90e4052c-c31c-4604-b185-b5612eca170c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:23.146194 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-90e4052c-c31c-4604-b185-b5612eca170c tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "POST /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270488 Aug 01 07:48:23.147003 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 566/1114] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 1 07:48:22 2022] POST /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:29.710880 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-28dbe2ae-059e-401b-94bb-2ca8bf58c701 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:29.711416 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-28dbe2ae-059e-401b-94bb-2ca8bf58c701 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:29.718686 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-28dbe2ae-059e-401b-94bb-2ca8bf58c701 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:29.719174 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-28dbe2ae-059e-401b-94bb-2ca8bf58c701 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:29.719928 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-28dbe2ae-059e-401b-94bb-2ca8bf58c701 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:29.720368 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-28dbe2ae-059e-401b-94bb-2ca8bf58c701 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:29.801521 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.objects.instance [None req-28dbe2ae-059e-401b-94bb-2ca8bf58c701 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lazy-loading 'services' on Instance uuid 4b88d866-9362-41dd-9880-585e3dacc495 {{(pid=124280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 07:48:29.873854 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-28dbe2ae-059e-401b-94bb-2ca8bf58c701 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/os-volume_attachments/8aa0f305-7373-4fe2-8929-a6f897a158be" status: 202 len: 0 microversion: 2.1 time: 0.166784 Aug 01 07:48:29.875031 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 549/1115] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 1 07:48:29 2022] DELETE /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/os-volume_attachments/8aa0f305-7373-4fe2-8929-a6f897a158be => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:48:29.884502 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-7ea5f8fe-c2ec-49cc-a005-a68fe0815566 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:29.887566 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-7ea5f8fe-c2ec-49cc-a005-a68fe0815566 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:29.894131 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7ea5f8fe-c2ec-49cc-a005-a68fe0815566 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:29.894839 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7ea5f8fe-c2ec-49cc-a005-a68fe0815566 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:29.895757 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7ea5f8fe-c2ec-49cc-a005-a68fe0815566 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:29.896201 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-7ea5f8fe-c2ec-49cc-a005-a68fe0815566 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:29.929260 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-7ea5f8fe-c2ec-49cc-a005-a68fe0815566 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049570 Aug 01 07:48:29.929748 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 567/1116] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:48:29 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:30.942813 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-7823af7f-257a-4e39-83a6-0fe0ea232241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:30.945241 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-7823af7f-257a-4e39-83a6-0fe0ea232241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:30.952171 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7823af7f-257a-4e39-83a6-0fe0ea232241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:30.952626 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7823af7f-257a-4e39-83a6-0fe0ea232241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:30.953403 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7823af7f-257a-4e39-83a6-0fe0ea232241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:30.953848 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-7823af7f-257a-4e39-83a6-0fe0ea232241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:30.982756 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-7823af7f-257a-4e39-83a6-0fe0ea232241 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044258 Aug 01 07:48:30.983343 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 550/1117] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 1 07:48:30 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 07:48:31.043374 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b8cbecd3-6173-411d-92cd-a06ed849d694 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:31.043871 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b8cbecd3-6173-411d-92cd-a06ed849d694 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:31.050174 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b8cbecd3-6173-411d-92cd-a06ed849d694 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:31.050622 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b8cbecd3-6173-411d-92cd-a06ed849d694 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:31.051405 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b8cbecd3-6173-411d-92cd-a06ed849d694 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:31.051837 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-b8cbecd3-6173-411d-92cd-a06ed849d694 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:31.077170 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-b8cbecd3-6173-411d-92cd-a06ed849d694 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Going to try to terminate instance {{(pid=124279) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 07:48:31.151025 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b8cbecd3-6173-411d-92cd-a06ed849d694 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 204 len: 0 microversion: 2.1 time: 0.111735 Aug 01 07:48:31.151644 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 568/1118] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:48:31 2022] DELETE /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 07:48:31.160538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-b5b3fdcb-5ee5-49a7-8b34-56249231a12f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:31.161159 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-b5b3fdcb-5ee5-49a7-8b34-56249231a12f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:31.167169 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b5b3fdcb-5ee5-49a7-8b34-56249231a12f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:31.168168 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b5b3fdcb-5ee5-49a7-8b34-56249231a12f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:31.169106 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b5b3fdcb-5ee5-49a7-8b34-56249231a12f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:31.169551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-b5b3fdcb-5ee5-49a7-8b34-56249231a12f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:31.300802 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-b5b3fdcb-5ee5-49a7-8b34-56249231a12f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:48:31.308337 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-b5b3fdcb-5ee5-49a7-8b34-56249231a12f tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1682 microversion: 2.1 time: 0.152090 Aug 01 07:48:31.308925 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 551/1119] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:48:31 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:48:32.330272 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-87c31b60-08cf-4e1c-9329-77dc5d138459 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:32.330967 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-87c31b60-08cf-4e1c-9329-77dc5d138459 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:32.337397 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-87c31b60-08cf-4e1c-9329-77dc5d138459 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:32.337848 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-87c31b60-08cf-4e1c-9329-77dc5d138459 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:32.338606 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-87c31b60-08cf-4e1c-9329-77dc5d138459 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:32.339039 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-87c31b60-08cf-4e1c-9329-77dc5d138459 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:32.470167 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.policy [None req-87c31b60-08cf-4e1c-9329-77dc5d138459 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124279) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:48:32.477710 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-87c31b60-08cf-4e1c-9329-77dc5d138459 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1682 microversion: 2.1 time: 0.151705 Aug 01 07:48:32.478272 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 569/1120] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:48:32 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:48:33.500257 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-549ee6ad-dbad-4373-952a-2d0b5ef501f6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:33.500796 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-549ee6ad-dbad-4373-952a-2d0b5ef501f6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:33.507656 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-549ee6ad-dbad-4373-952a-2d0b5ef501f6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:33.508120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-549ee6ad-dbad-4373-952a-2d0b5ef501f6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:33.508905 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-549ee6ad-dbad-4373-952a-2d0b5ef501f6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:33.509347 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-549ee6ad-dbad-4373-952a-2d0b5ef501f6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:33.697968 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.policy [None req-549ee6ad-dbad-4373-952a-2d0b5ef501f6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba46a929ed54c51a33662367289eee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0013064fc495285dad557b0beef7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124280) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 07:48:33.706538 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-549ee6ad-dbad-4373-952a-2d0b5ef501f6 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 200 len: 1682 microversion: 2.1 time: 0.211557 Aug 01 07:48:33.707125 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 552/1121] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:48:33 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:48:34.155562 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [req-21aed087-9fe0-4d44-8324-8022b1bc2897 req-bd62490b-d1f1-446c-b2a7-35d924ed056a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88d866-9362-41dd-9880-585e3dacc495", "name": "network-vif-deleted", "tag": "433ad631-ebba-4854-909e-a4e5aab5bed1"}]} {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:48:34.166854 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-21aed087-9fe0-4d44-8324-8022b1bc2897 req-bd62490b-d1f1-446c-b2a7-35d924ed056a service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:34.167427 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [req-21aed087-9fe0-4d44-8324-8022b1bc2897 req-bd62490b-d1f1-446c-b2a7-35d924ed056a service nova] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:34.179830 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.compute.server_external_events [req-21aed087-9fe0-4d44-8324-8022b1bc2897 req-bd62490b-d1f1-446c-b2a7-35d924ed056a service nova] Creating event network-vif-deleted:433ad631-ebba-4854-909e-a4e5aab5bed1 for instance 4b88d866-9362-41dd-9880-585e3dacc495 on hv-cinder-73306 Aug 01 07:48:34.185577 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [req-21aed087-9fe0-4d44-8324-8022b1bc2897 req-bd62490b-d1f1-446c-b2a7-35d924ed056a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186119 Aug 01 07:48:34.186281 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 570/1122] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 1 07:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:34.727891 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-12975735-9001-4fe6-975b-727941ee28f3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:34.728591 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-12975735-9001-4fe6-975b-727941ee28f3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:34.735371 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-12975735-9001-4fe6-975b-727941ee28f3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:34.735824 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-12975735-9001-4fe6-975b-727941ee28f3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:34.736597 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-12975735-9001-4fe6-975b-727941ee28f3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:34.737030 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-12975735-9001-4fe6-975b-727941ee28f3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:34.752565 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-12975735-9001-4fe6-975b-727941ee28f3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-12975735-9001-4fe6-975b-727941ee28f3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 HTTP/1.1 Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:48:34.754209 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:34.755993 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '4b88d866-9362-41dd-9880-585e3dacc495'} Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:48:34.756964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:34.758609 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:34.760047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-12975735-9001-4fe6-975b-727941ee28f3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:48:34.760047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-12975735-9001-4fe6-975b-727941ee28f3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 404 len: 111 microversion: 2.1 time: 0.032789 Aug 01 07:48:34.760047 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 553/1123] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:48:34 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:48:34.765905 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-88ce5a96-7791-446d-8ff4-e7cbc293c1cc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '.version_select at 0x7fd018bc2b80>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:34.785358 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-88ce5a96-7791-446d-8ff4-e7cbc293c1cc tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138812686" status: 202 len: 0 microversion: 2.1 time: 0.023520 Aug 01 07:48:34.785933 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 571/1124] 10.222.0.40 () {58 vars in 1221 bytes} [Mon Aug 1 07:48:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138812686 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 07:48:36.541910 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5fbd28d4-14b5-48be-9c2d-7d6cc5d26ca7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:36.542453 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-5fbd28d4-14b5-48be-9c2d-7d6cc5d26ca7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:36.548868 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5fbd28d4-14b5-48be-9c2d-7d6cc5d26ca7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:36.549317 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5fbd28d4-14b5-48be-9c2d-7d6cc5d26ca7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:36.550080 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5fbd28d4-14b5-48be-9c2d-7d6cc5d26ca7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:36.550515 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-5fbd28d4-14b5-48be-9c2d-7d6cc5d26ca7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:36.564550 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-5fbd28d4-14b5-48be-9c2d-7d6cc5d26ca7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5fbd28d4-14b5-48be-9c2d-7d6cc5d26ca7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 HTTP/1.1 Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:48:36.566135 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:36.567903 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '4b88d866-9362-41dd-9880-585e3dacc495'} Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:48:36.568892 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:36.570562 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:36.572186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5fbd28d4-14b5-48be-9c2d-7d6cc5d26ca7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:48:36.572186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5fbd28d4-14b5-48be-9c2d-7d6cc5d26ca7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 404 len: 111 microversion: 2.1 time: 0.029718 Aug 01 07:48:36.572186 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 554/1125] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:48:36 2022] DELETE /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:48:36.576934 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-34d41d25-9635-4a29-9022-3b63f8a647e3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:36.577667 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-34d41d25-9635-4a29-9022-3b63f8a647e3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 4b88d866-9362-41dd-9880-585e3dacc495] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:36.584324 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-34d41d25-9635-4a29-9022-3b63f8a647e3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:36.584779 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-34d41d25-9635-4a29-9022-3b63f8a647e3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:36.585535 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-34d41d25-9635-4a29-9022-3b63f8a647e3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:36.585971 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-34d41d25-9635-4a29-9022-3b63f8a647e3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:36.598904 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-34d41d25-9635-4a29-9022-3b63f8a647e3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-34d41d25-9635-4a29-9022-3b63f8a647e3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 HTTP/1.1 Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:48:36.600523 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:36.602220 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '4b88d866-9362-41dd-9880-585e3dacc495'} Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:48:36.603266 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. Aug 01 07:48:36.604780 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:36.606484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-34d41d25-9635-4a29-9022-3b63f8a647e3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance 4b88d866-9362-41dd-9880-585e3dacc495 could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:48:36.606484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-34d41d25-9635-4a29-9022-3b63f8a647e3 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495" status: 404 len: 111 microversion: 2.1 time: 0.029897 Aug 01 07:48:36.606484 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 572/1126] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:48:36 2022] GET /compute/v2.1/servers/4b88d866-9362-41dd-9880-585e3dacc495 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:48:37.741056 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-78be5768-4564-4f9e-948e-1cf1409fb816 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:37.741620 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-78be5768-4564-4f9e-948e-1cf1409fb816 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:37.748650 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78be5768-4564-4f9e-948e-1cf1409fb816 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:37.749098 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78be5768-4564-4f9e-948e-1cf1409fb816 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:37.750120 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78be5768-4564-4f9e-948e-1cf1409fb816 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:37.750551 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-78be5768-4564-4f9e-948e-1cf1409fb816 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:37.765638 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-78be5768-4564-4f9e-948e-1cf1409fb816 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-78be5768-4564-4f9e-948e-1cf1409fb816 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 HTTP/1.1 Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:48:37.767189 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:48:37.768850 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'e3d523a7-6f42-441f-9e01-bf42a5a55e76'} Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:48:37.769740 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:48:37.771386 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.772899 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-78be5768-4564-4f9e-948e-1cf1409fb816 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:48:37.772899 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-78be5768-4564-4f9e-948e-1cf1409fb816 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 404 len: 111 microversion: 2.1 time: 0.031363 Aug 01 07:48:37.772899 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 555/1127] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:48:37 2022] DELETE /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:48:37.778989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-693aed7f-dc82-4ad1-8eab-be0da018e8d7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:37.779640 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-693aed7f-dc82-4ad1-8eab-be0da018e8d7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: e3d523a7-6f42-441f-9e01-bf42a5a55e76] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:37.786541 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-693aed7f-dc82-4ad1-8eab-be0da018e8d7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:37.786995 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-693aed7f-dc82-4ad1-8eab-be0da018e8d7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:37.788172 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-693aed7f-dc82-4ad1-8eab-be0da018e8d7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:37.788781 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-693aed7f-dc82-4ad1-8eab-be0da018e8d7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:37.802277 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-693aed7f-dc82-4ad1-8eab-be0da018e8d7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-693aed7f-dc82-4ad1-8eab-be0da018e8d7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 HTTP/1.1 Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:48:37.803812 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:48:37.805437 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': 'e3d523a7-6f42-441f-9e01-bf42a5a55e76'} Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:48:37.806330 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. Aug 01 07:48:37.807844 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.809463 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-693aed7f-dc82-4ad1-8eab-be0da018e8d7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance e3d523a7-6f42-441f-9e01-bf42a5a55e76 could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:48:37.809463 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-693aed7f-dc82-4ad1-8eab-be0da018e8d7 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76" status: 404 len: 111 microversion: 2.1 time: 0.030936 Aug 01 07:48:37.809463 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 573/1128] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:48:37 2022] GET /compute/v2.1/servers/e3d523a7-6f42-441f-9e01-bf42a5a55e76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:48:37.813812 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d7bef55f-abe0-4f5f-83b2-d856d6bcda22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:37.814309 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-d7bef55f-abe0-4f5f-83b2-d856d6bcda22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:37.820287 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d7bef55f-abe0-4f5f-83b2-d856d6bcda22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:37.820747 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d7bef55f-abe0-4f5f-83b2-d856d6bcda22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:37.821508 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d7bef55f-abe0-4f5f-83b2-d856d6bcda22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:37.821951 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-d7bef55f-abe0-4f5f-83b2-d856d6bcda22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:37.835834 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-d7bef55f-abe0-4f5f-83b2-d856d6bcda22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d7bef55f-abe0-4f5f-83b2-d856d6bcda22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 HTTP/1.1 Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:48:37.837351 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:48:37.838958 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': '655fec6a-966b-4749-a00d-7c24e27bfaa1'} Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:48:37.840674 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:48:37.841969 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.843374 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-d7bef55f-abe0-4f5f-83b2-d856d6bcda22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:48:37.843374 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-d7bef55f-abe0-4f5f-83b2-d856d6bcda22 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 404 len: 111 microversion: 2.1 time: 0.028697 Aug 01 07:48:37.843374 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 556/1129] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:48:37 2022] DELETE /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:48:37.847477 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1bfa84f8-efe0-48a1-a83f-1e7b57c7287d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:37.848080 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-1bfa84f8-efe0-48a1-a83f-1e7b57c7287d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: 655fec6a-966b-4749-a00d-7c24e27bfaa1] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:37.854029 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1bfa84f8-efe0-48a1-a83f-1e7b57c7287d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:37.854475 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1bfa84f8-efe0-48a1-a83f-1e7b57c7287d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:37.855255 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1bfa84f8-efe0-48a1-a83f-1e7b57c7287d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:37.855686 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-1bfa84f8-efe0-48a1-a83f-1e7b57c7287d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:37.868529 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-1bfa84f8-efe0-48a1-a83f-1e7b57c7287d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1bfa84f8-efe0-48a1-a83f-1e7b57c7287d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 HTTP/1.1 Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:48:37.870008 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:48:37.871770 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': '655fec6a-966b-4749-a00d-7c24e27bfaa1'} Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:48:37.872829 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. Aug 01 07:48:37.874377 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:37.876279 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1bfa84f8-efe0-48a1-a83f-1e7b57c7287d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance 655fec6a-966b-4749-a00d-7c24e27bfaa1 could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:48:37.876279 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1bfa84f8-efe0-48a1-a83f-1e7b57c7287d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1" status: 404 len: 111 microversion: 2.1 time: 0.027680 Aug 01 07:48:37.876279 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 574/1130] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:48:37 2022] GET /compute/v2.1/servers/655fec6a-966b-4749-a00d-7c24e27bfaa1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:48:39.013148 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fb8b146e-b368-4d09-aba9-9da40db1e84d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:39.013640 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.compute.api [None req-fb8b146e-b368-4d09-aba9-9da40db1e84d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124280) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:39.020041 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb8b146e-b368-4d09-aba9-9da40db1e84d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:39.020486 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb8b146e-b368-4d09-aba9-9da40db1e84d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:39.021249 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb8b146e-b368-4d09-aba9-9da40db1e84d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:39.021684 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG oslo_concurrency.lockutils [None req-fb8b146e-b368-4d09-aba9-9da40db1e84d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:39.035179 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.wsgi [None req-fb8b146e-b368-4d09-aba9-9da40db1e84d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fb8b146e-b368-4d09-aba9-9da40db1e84d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: request: DELETE /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 HTTP/1.1 Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept: application/json Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Accept-Encoding: identity Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Connection: close Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Length: 0 Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Content-Type: application/json Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Host: 10.222.0.40 Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Openstack-System-Scope: None Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: User-Agent: python-urllib3/1.26.10 Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Id: None Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Domain-Name: None Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Identity-Status: Confirmed Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Is-Admin-Project: True Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Id: default Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Domain-Name: Default Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Role: reader,member Aug 01 07:48:39.036688 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Roles: reader,member Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Id: default Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Domain-Name: Default Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: method: > Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: exception: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:48:39.038323 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: action_args: {'id': 'd7638196-f31a-47de-8500-475937e17054'} Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:48:39.039183 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:48:39.040667 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: ERROR nova.api.openstack.wsgi Aug 01 07:48:39.042196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-fb8b146e-b368-4d09-aba9-9da40db1e84d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. {{(pid=124280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:48:39.042196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-fb8b146e-b368-4d09-aba9-9da40db1e84d tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 404 len: 111 microversion: 2.1 time: 0.028835 Aug 01 07:48:39.042196 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 557/1131] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 1 07:48:39 2022] DELETE /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 07:48:39.046995 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-92287b42-4382-463c-a4c8-7cfe3d637e54 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Calling method '>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:39.047652 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.compute.api [None req-92287b42-4382-463c-a4c8-7cfe3d637e54 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] [instance: d7638196-f31a-47de-8500-475937e17054] Fetching instance by UUID {{(pid=124279) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 07:48:39.054587 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-92287b42-4382-463c-a4c8-7cfe3d637e54 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:39.055034 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-92287b42-4382-463c-a4c8-7cfe3d637e54 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:39.055857 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-92287b42-4382-463c-a4c8-7cfe3d637e54 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:48:39.056321 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG oslo_concurrency.lockutils [None req-92287b42-4382-463c-a4c8-7cfe3d637e54 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Lock "bc6ae24f-0fe6-4fae-ac28-8855099a2e0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:48:39.069613 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.wsgi [None req-92287b42-4382-463c-a4c8-7cfe3d637e54 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] HTTP exception thrown: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-92287b42-4382-463c-a4c8-7cfe3d637e54 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Request method failure captured: Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: request: GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 HTTP/1.1 Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept: application/json Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Accept-Encoding: identity Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Connection: close Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Length: 0 Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Content-Type: application/json Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Host: 10.222.0.40 Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Openstack-System-Scope: None Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: User-Agent: python-urllib3/1.26.10 Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Auth-Token: gAAAAABi54RVmaFluuqIfDZMI8uC0VubCltckyFY7aVb2sv7YxlUt2H1ZdMhe2pCQb5DHjJu6x_S5AqsKVKQ5jXMSRk7CfEd2gZaO5HONwKYD8v7KQBn6y8Z6GpASEXN7BmS7MVauFNIL7LDV7MgqTr6shXkDWaiuLHhgunO4ezeE1qb15lWrjU Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Id: None Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Domain-Name: None Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Identity-Status: Confirmed Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Is-Admin-Project: True Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Id: default Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Domain-Name: Default Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Project-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Role: reader,member Aug 01 07:48:39.071166 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Roles: reader,member Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49e0013064fc495285dad557b0beef7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49e0013064fc495285dad557b0beef7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49e0013064fc495285dad557b0beef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Id: 49e0013064fc495285dad557b0beef7d Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-842463552 Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Id: default Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Domain-Name: Default Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Id: 1ba46a929ed54c51a33662367289eee5 Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: X-User-Name: tempest-AttachVolumeNegativeTest-842463552-project Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: method: > Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: exception: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:48:39.072989 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: action_args: {'id': 'd7638196-f31a-47de-8500-475937e17054'} Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:48:39.074400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. Aug 01 07:48:39.075945 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: ERROR nova.api.openstack.wsgi Aug 01 07:48:39.077292 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-92287b42-4382-463c-a4c8-7cfe3d637e54 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] Returning 404 to user: Instance d7638196-f31a-47de-8500-475937e17054 could not be found. {{(pid=124279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:48:39.077292 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-92287b42-4382-463c-a4c8-7cfe3d637e54 tempest-AttachVolumeNegativeTest-842463552 tempest-AttachVolumeNegativeTest-842463552-project] 10.222.0.40 "GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054" status: 404 len: 111 microversion: 2.1 time: 0.029998 Aug 01 07:48:39.077292 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 575/1132] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 1 07:48:39 2022] GET /compute/v2.1/servers/d7638196-f31a-47de-8500-475937e17054 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 07:48:44.677235 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-62e35250-72fa-46c3-9c4d-bd74d50165fb tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd01d248ca0>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:44.723577 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-62e35250-72fa-46c3-9c4d-bd74d50165fb tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/4b83ee43-5d4c-4dd2-bf0e-cc40e46b278f" status: 200 len: 351 microversion: 2.1 time: 0.050179 Aug 01 07:48:44.724125 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 558/1133] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:48:44 2022] GET /compute/v2.1/os-volumes/4b83ee43-5d4c-4dd2-bf0e-cc40e46b278f => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:46.052674 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-44f71307-2a4b-4665-b857-7a263dfffa69 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd018a62700>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:46.100605 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-44f71307-2a4b-4665-b857-7a263dfffa69 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/2470a4fe-15ee-4597-b543-bd3968910371" status: 200 len: 351 microversion: 2.1 time: 0.051687 Aug 01 07:48:46.101167 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 576/1134] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:48:46 2022] GET /compute/v2.1/os-volumes/2470a4fe-15ee-4597-b543-bd3968910371 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:47.428649 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-c6a0d017-81d7-4df2-9865-e4b3eb0b1f65 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd018ac9280>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:47.473259 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-c6a0d017-81d7-4df2-9865-e4b3eb0b1f65 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/cfe960ed-0f7e-4bf9-a757-71d9b26109d0" status: 200 len: 351 microversion: 2.1 time: 0.048802 Aug 01 07:48:47.473811 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 559/1135] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 1 07:48:47 2022] GET /compute/v2.1/os-volumes/cfe960ed-0f7e-4bf9-a757-71d9b26109d0 => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:47.487043 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-1e335820-f79a-4ae7-968e-eb12eb3bbf17 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd018bf5ee0>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:47.571781 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-1e335820-f79a-4ae7-968e-eb12eb3bbf17 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088910 Aug 01 07:48:47.572352 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 577/1136] 10.222.0.40 () {58 vars in 1134 bytes} [Mon Aug 1 07:48:47 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:48:47.585762 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5f84d2a2-7e36-4785-98e3-0004b6a815b5 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd01d242820>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:47.669310 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5f84d2a2-7e36-4785-98e3-0004b6a815b5 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087162 Aug 01 07:48:47.669880 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 560/1137] 10.222.0.40 () {58 vars in 1149 bytes} [Mon Aug 1 07:48:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:47.682821 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-b085b543-3c75-4699-a66d-ece364315a97 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd018bf5160>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:47.763729 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-b085b543-3c75-4699-a66d-ece364315a97 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084549 Aug 01 07:48:47.764328 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 578/1138] 10.222.0.40 () {58 vars in 1134 bytes} [Mon Aug 1 07:48:47 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:48:47.776717 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-32d79e3e-e84c-4ca0-b0e1-4ec7bc16d7f4 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd018a1dc10>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:47.860004 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-32d79e3e-e84c-4ca0-b0e1-4ec7bc16d7f4 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086946 Aug 01 07:48:47.860581 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 561/1139] 10.222.0.40 () {58 vars in 1167 bytes} [Mon Aug 1 07:48:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:47.873474 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-afb7eaf3-a829-4fe9-8916-215c7b6dd6cd tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd01875c160>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:47.955198 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-afb7eaf3-a829-4fe9-8916-215c7b6dd6cd tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085405 Aug 01 07:48:47.955762 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 579/1140] 10.222.0.40 () {58 vars in 1170 bytes} [Mon Aug 1 07:48:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:47.968750 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5aed7300-d4d3-48eb-96f1-05ef8fe4546a tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd018ac91f0>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:48.049385 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5aed7300-d4d3-48eb-96f1-05ef8fe4546a tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084439 Aug 01 07:48:48.049951 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 562/1141] 10.222.0.40 () {58 vars in 1155 bytes} [Mon Aug 1 07:48:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:48:48.063475 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: DEBUG nova.api.openstack.wsgi [None req-a6ad96d6-2d86-435c-bcca-c351c9839942 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd018c140d0>' {{(pid=124279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:48.149949 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO nova.api.openstack.requestlog [None req-a6ad96d6-2d86-435c-bcca-c351c9839942 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090166 Aug 01 07:48:48.150538 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: [pid: 124279|app: 0|req: 580/1142] 10.222.0.40 () {58 vars in 1188 bytes} [Mon Aug 1 07:48:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:48:48.163810 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: DEBUG nova.api.openstack.wsgi [None req-5fe88fb3-81ee-4ad6-bb38-3da998907925 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] Calling method '.version_select at 0x7fd018a591f0>' {{(pid=124280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:48:48.248558 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO nova.api.openstack.requestlog [None req-5fe88fb3-81ee-4ad6-bb38-3da998907925 tempest-VolumesTestJSON-646417900 tempest-VolumesTestJSON-646417900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.088474 Aug 01 07:48:48.249208 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: [pid: 124280|app: 0|req: 563/1143] 10.222.0.40 () {58 vars in 1155 bytes} [Mon Aug 1 07:48:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:49:06.939737 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:49:06.940390 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Mon Aug 1 07:49:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 07:50:37.455377 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:50:37.455964 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Mon Aug 1 07:50:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 07:50:46.709949 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:50:46.710675 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Mon Aug 1 07:50:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 07:51:12.042136 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:51:12.042672 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Mon Aug 1 07:51:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 07:51:17.138150 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:51:17.138664 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Mon Aug 1 07:51:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 07:52:26.948390 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:52:26.949221 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Mon Aug 1 07:52:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 07:53:57.464814 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:53:57.465429 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Mon Aug 1 07:53:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 07:54:06.718167 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:54:06.718815 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Mon Aug 1 07:54:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 07:54:07.608334 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:54:07.608952 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Mon Aug 1 07:54:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 07:54:32.050715 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:54:32.051400 dv-cinder-733062-31-iscsi devstack@n-api.service[124279]: Mon Aug 1 07:54:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 07:54:37.146421 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 07:54:37.146929 dv-cinder-733062-31-iscsi devstack@n-api.service[124280]: Mon Aug 1 07:54:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!